2026-02-12T20:29:02.356 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T20:29:02.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T20:29:02.455 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46720 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '46720' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 7172 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5RGJrx8QAvJ/o941erfL/3JNKe4JksyqZHFFzZHHJCJM4Pmfr9s2eDCAqsAQ2tGhIGGA5kVq+tE8RwEwiI+Yw= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_15:38:14 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T20:29:02.455 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-12T20:29:02.455 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-12T20:29:02.455 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T20:29:02.457 INFO:teuthology.task.internal:Checking packages... 2026-02-12T20:29:02.457 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-12T20:29:02.457 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T20:29:02.457 INFO:teuthology.packaging:ref: None 2026-02-12T20:29:02.457 INFO:teuthology.packaging:tag: None 2026-02-12T20:29:02.457 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-12T20:29:02.457 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T20:29:02.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-12T20:29:02.572 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230.gafefaa40 2026-02-12T20:29:02.573 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T20:29:02.586 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T20:29:02.586 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T20:29:02.600 INFO:teuthology.task.internal:Saving configuration 2026-02-12T20:29:02.604 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T20:29:02.616 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T20:29:02.673 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial099.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46720', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 20:25:42.920950', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5RGJrx8QAvJ/o941erfL/3JNKe4JksyqZHFFzZHHJCJM4Pmfr9s2eDCAqsAQ2tGhIGGA5kVq+tE8RwEwiI+Yw='} 2026-02-12T20:29:02.674 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T20:29:02.685 INFO:teuthology.task.internal:roles: ubuntu@trial099.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-12T20:29:02.685 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T20:29:02.759 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d852ffd51c0>, signals=[15]) 2026-02-12T20:29:02.759 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T20:29:02.770 INFO:teuthology.task.internal:Opening connections... 2026-02-12T20:29:02.770 DEBUG:teuthology.task.internal:connecting to ubuntu@trial099.front.sepia.ceph.com 2026-02-12T20:29:02.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T20:29:02.833 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T20:29:02.845 DEBUG:teuthology.orchestra.run.trial099:> uname -m 2026-02-12T20:29:02.905 INFO:teuthology.orchestra.run.trial099.stdout:x86_64 2026-02-12T20:29:02.905 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:NAME="CentOS Stream" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="9" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:ID="centos" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel fedora" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="9" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el9" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;31" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://centos.org/" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T20:29:02.960 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T20:29:02.961 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server 2026-02-12T20:29:03.021 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T20:29:03.032 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T20:29:03.044 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T20:29:03.044 DEBUG:teuthology.orchestra.run.trial099:> test '!' -e /home/ubuntu/cephtest 2026-02-12T20:29:03.059 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T20:29:03.070 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T20:29:03.070 DEBUG:teuthology.orchestra.run.trial099:> test -z $(ls -A /var/lib/ceph) 2026-02-12T20:29:03.116 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T20:29:03.208 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T20:29:03.227 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-12T20:29:03.228 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-12T20:29:03.228 DEBUG:teuthology.orchestra.run.trial099:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T20:29:03.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T20:29:03.242 DEBUG:teuthology.orchestra.run.trial099:> uname -r 2026-02-12T20:29:03.298 INFO:teuthology.orchestra.run.trial099.stdout:5.14.0-645.el9.x86_64 2026-02-12T20:29:03.298 INFO:teuthology.task.kernel:Running kernel on trial099: 5.14.0-645.el9.x86_64 2026-02-12T20:29:03.298 DEBUG:teuthology.orchestra.run.trial099:> sudo yum install -y kernel 2026-02-12T20:29:12.281 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-12T20:29:15.383 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T20:29:18.735 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 7.8 MB 00:00 2026-02-12T20:29:20.565 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-12T20:29:21.369 INFO:teuthology.orchestra.run.trial099.stdout:Extra Packages for Enterprise Linux 28 MB/s | 20 MB 00:00 2026-02-12T20:29:24.580 INFO:teuthology.orchestra.run.trial099.stdout:lab-extras 2.3 MB/s | 50 kB 00:00 2026-02-12T20:29:25.643 INFO:teuthology.orchestra.run.trial099.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T20:29:25.663 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:29:25.664 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:29:25.664 INFO:teuthology.orchestra.run.trial099.stdout: Package Architecture Version Repository Size 2026-02-12T20:29:25.664 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:29:25.665 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:29:25.666 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:29:25.666 INFO:teuthology.orchestra.run.trial099.stdout:Install 4 Packages 2026-02-12T20:29:25.666 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:29:25.666 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 88 M 2026-02-12T20:29:25.666 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 135 M 2026-02-12T20:29:25.666 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:29:26.104 INFO:teuthology.orchestra.run.trial099.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 5.6 MB/s | 768 kB 00:00 2026-02-12T20:29:26.252 INFO:teuthology.orchestra.run.trial099.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 61 MB/s | 17 MB 00:00 2026-02-12T20:29:26.429 INFO:teuthology.orchestra.run.trial099.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 86 MB/s | 40 MB 00:00 2026-02-12T20:29:26.679 INFO:teuthology.orchestra.run.trial099.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 54 MB/s | 31 MB 00:00 2026-02-12T20:29:26.679 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:29:26.679 INFO:teuthology.orchestra.run.trial099.stdout:Total 87 MB/s | 88 MB 00:01 2026-02-12T20:29:26.863 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:29:27.066 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:29:27.066 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:29:27.411 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:29:27.412 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:29:28.506 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:29:28.794 INFO:teuthology.orchestra.run.trial099.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T20:29:28.813 INFO:teuthology.orchestra.run.trial099.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T20:29:30.589 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T20:29:30.618 INFO:teuthology.orchestra.run.trial099.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T20:29:33.656 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T20:29:33.662 INFO:teuthology.orchestra.run.trial099.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T20:29:36.705 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T20:30:07.125 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T20:30:07.147 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T20:30:07.214 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T20:30:07.215 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T20:30:07.215 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T20:30:07.215 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T20:30:07.269 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T20:30:07.269 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:30:07.269 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:30:07.270 INFO:teuthology.orchestra.run.trial099.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.270 INFO:teuthology.orchestra.run.trial099.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.270 INFO:teuthology.orchestra.run.trial099.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.270 INFO:teuthology.orchestra.run.trial099.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.270 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:30:07.270 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:30:07.326 DEBUG:teuthology.orchestra.run.trial099:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T20:30:07.391 INFO:teuthology.orchestra.run.trial099.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.392 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T20:30:07.392 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T20:30:07.392 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T20:30:07.393 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T20:30:07.393 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T20:30:07.393 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial099.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T20:30:07.393 DEBUG:teuthology.orchestra.run.trial099:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T20:30:07.455 INFO:teuthology.orchestra.run.trial099.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.456 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T20:30:07.456 DEBUG:teuthology.orchestra.run.trial099:> sudo rpm -qi grub2-tools 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Name : grub2-tools 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Epoch : 1 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Version : 2.06 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Release : 118.el9 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Architecture: x86_64 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T20:30:07.525 INFO:teuthology.orchestra.run.trial099.stdout:Group : Unspecified 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Size : 8393909 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:License : GPLv3+ 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Packager : builder@centos.org 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Vendor : CentOS 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Summary : Support tools for GRUB. 2026-02-12T20:30:07.526 INFO:teuthology.orchestra.run.trial099.stdout:Description : 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout:hardware devices. 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:30:07.527 INFO:teuthology.orchestra.run.trial099.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T20:30:07.528 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T20:30:07.528 INFO:teuthology.task.kernel:Updating grub on trial099 to boot 5.14.0-677.el9.x86_64 2026-02-12T20:30:07.529 DEBUG:teuthology.orchestra.run.trial099:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T20:30:07.592 INFO:teuthology.orchestra.run.trial099.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T20:30:07.593 DEBUG:teuthology.orchestra.run.trial099:> sudo command -v grubby && echo yes || echo no 2026-02-12T20:30:07.656 INFO:teuthology.orchestra.run.trial099.stdout:/sbin/grubby 2026-02-12T20:30:07.658 INFO:teuthology.orchestra.run.trial099.stdout:yes 2026-02-12T20:30:07.658 DEBUG:teuthology.orchestra.run.trial099:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T20:30:07.723 INFO:teuthology.orchestra.run.trial099.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T20:30:07.725 DEBUG:teuthology.orchestra.run.trial099:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T20:30:07.796 DEBUG:teuthology.orchestra.run.trial099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T20:30:08.006 INFO:teuthology.orchestra.run.trial099.stderr:Generating grub configuration file ... 2026-02-12T20:30:08.071 INFO:teuthology.orchestra.run.trial099.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T20:30:08.077 INFO:teuthology.orchestra.run.trial099.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T20:30:08.332 INFO:teuthology.orchestra.run.trial099.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T20:30:08.339 INFO:teuthology.orchestra.run.trial099.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T20:30:08.370 INFO:teuthology.orchestra.run.trial099.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T20:30:08.376 INFO:teuthology.orchestra.run.trial099.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T20:30:08.400 INFO:teuthology.orchestra.run.trial099.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T20:30:08.406 INFO:teuthology.orchestra.run.trial099.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T20:30:08.487 INFO:teuthology.orchestra.run.trial099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T20:30:08.495 INFO:teuthology.orchestra.run.trial099.stderr:done 2026-02-12T20:30:08.497 DEBUG:teuthology.orchestra.run.trial099:> test -d /sys/firmware/efi 2026-02-12T20:30:08.513 DEBUG:teuthology.orchestra.run.trial099:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T20:30:08.578 INFO:teuthology.orchestra.run.trial099.stdout:/boot/efi/EFI/BOOT 2026-02-12T20:30:08.578 INFO:teuthology.orchestra.run.trial099.stdout:/boot/efi/EFI/centos 2026-02-12T20:30:08.580 DEBUG:teuthology.orchestra.run.trial099:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T20:30:08.646 INFO:teuthology.orchestra.run.trial099.stdout:no 2026-02-12T20:30:08.646 DEBUG:teuthology.orchestra.run.trial099:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T20:30:08.712 INFO:teuthology.orchestra.run.trial099.stdout:yes 2026-02-12T20:30:08.712 DEBUG:teuthology.orchestra.run.trial099:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T20:30:08.776 DEBUG:teuthology.orchestra.run.trial099:> sudo shutdown -r now 2026-02-12T20:30:38.849 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T20:30:38.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-12T20:30:38.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T20:31:38.909 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T20:31:47.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-12T20:31:47.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T20:31:48.053 DEBUG:teuthology.orchestra.run.trial099:> true 2026-02-12T20:31:48.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-12T20:31:48.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T20:31:48.210 DEBUG:teuthology.orchestra.run.trial099:> uname -r 2026-02-12T20:31:48.265 INFO:teuthology.orchestra.run.trial099.stdout:5.14.0-677.el9.x86_64 2026-02-12T20:31:48.265 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T20:31:48.265 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T20:31:48.265 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T20:31:49.267 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T20:31:49.267 DEBUG:teuthology.orchestra.run.trial099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T20:31:49.295 INFO:teuthology.orchestra.run.trial099.stdout:ttyS1 2026-02-12T20:31:49.318 DEBUG:teuthology.parallel:result is None 2026-02-12T20:31:49.318 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T20:31:49.329 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T20:31:49.329 DEBUG:teuthology.orchestra.run.trial099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T20:31:49.375 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T20:31:49.391 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T20:31:49.401 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T20:31:49.401 DEBUG:teuthology.orchestra.run.trial099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T20:31:49.439 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T20:31:49.450 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T20:31:49.451 DEBUG:teuthology.orchestra.run.trial099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T20:31:49.497 INFO:teuthology.orchestra.run.trial099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:31:49.505 INFO:teuthology.orchestra.run.trial099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:31:49.507 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T20:31:49.519 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T20:31:49.519 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T20:31:49.572 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T20:31:49.589 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T20:31:49.590 DEBUG:teuthology.orchestra.run.trial099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T20:31:49.628 DEBUG:teuthology.orchestra.run.trial099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T20:31:49.792 DEBUG:teuthology.orchestra.run.trial099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T20:31:49.818 DEBUG:teuthology.orchestra.run.trial099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T20:31:49.966 DEBUG:teuthology.orchestra.run.trial099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T20:31:49.990 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:31:49.990 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T20:31:50.054 DEBUG:teuthology.orchestra.run.trial099:> sudo service rsyslog restart 2026-02-12T20:31:50.122 INFO:teuthology.orchestra.run.trial099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T20:31:50.434 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T20:31:50.448 INFO:teuthology.task.internal:Starting timer... 2026-02-12T20:31:50.450 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T20:31:50.474 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T20:31:50.490 DEBUG:teuthology.orchestra.run.trial099:> sudo service auditd rotate 2026-02-12T20:31:50.520 INFO:teuthology.orchestra.run.trial099.stdout:Rotating logs: 2026-02-12T20:31:50.521 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T20:31:50.522 DEBUG:teuthology.orchestra.run.trial099:> /usr/sbin/getenforce 2026-02-12T20:31:50.577 INFO:teuthology.orchestra.run.trial099.stdout:Permissive 2026-02-12T20:31:50.578 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial099.front.sepia.ceph.com': 'permissive'} 2026-02-12T20:31:50.578 DEBUG:teuthology.orchestra.run.trial099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T20:31:50.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T20:31:50.642 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T20:31:50.643 DEBUG:teuthology.orchestra.run.trial099:> sudo /usr/sbin/setenforce permissive 2026-02-12T20:31:50.708 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T20:31:50.723 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T20:31:50.736 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T20:31:50.738 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T20:32:56.373 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial099.front.sepia.ceph.com')] 2026-02-12T20:32:56.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-12T20:32:56.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T20:32:56.485 DEBUG:teuthology.orchestra.run.trial099:> true 2026-02-12T20:32:56.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-12T20:32:56.561 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T20:32:56.574 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T20:32:56.574 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T20:32:56.575 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T20:32:56.627 INFO:teuthology.orchestra.run.trial099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T20:32:56.639 INFO:teuthology.orchestra.run.trial099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T20:32:56.660 INFO:teuthology.orchestra.run.trial099.stderr:sudo: ntpd: command not found 2026-02-12T20:32:56.669 INFO:teuthology.orchestra.run.trial099.stdout:506 Cannot talk to daemon 2026-02-12T20:32:56.681 INFO:teuthology.orchestra.run.trial099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T20:32:56.692 INFO:teuthology.orchestra.run.trial099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T20:32:56.742 INFO:teuthology.orchestra.run.trial099.stderr:bash: line 1: ntpq: command not found 2026-02-12T20:32:56.757 INFO:teuthology.orchestra.run.trial099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T20:32:56.757 INFO:teuthology.orchestra.run.trial099.stdout:=============================================================================== 2026-02-12T20:32:56.757 INFO:teuthology.orchestra.run.trial099.stdout:^? 23.157.160.168 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T20:32:56.757 INFO:teuthology.orchestra.run.trial099.stdout:^? t2.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T20:32:56.757 INFO:teuthology.orchestra.run.trial099.stdout:^? gopher.fart.website 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T20:32:56.757 INFO:teuthology.orchestra.run.trial099.stdout:^? ntp11.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T20:32:56.759 INFO:teuthology.run_tasks:Running task install... 2026-02-12T20:32:56.772 DEBUG:teuthology.task.install:project ceph 2026-02-12T20:32:56.772 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-12T20:32:56.772 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-12T20:32:56.772 INFO:teuthology.task.install:Using flavor: default 2026-02-12T20:32:56.781 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T20:32:56.781 INFO:teuthology.task.install:extra packages: [] 2026-02-12T20:32:56.782 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-12T20:32:56.782 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T20:32:56.957 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-12T20:32:56.957 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-12T20:32:57.110 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T20:32:57.110 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:32:57.111 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T20:32:57.136 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T20:32:57.136 DEBUG:teuthology.orchestra.run.trial099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T20:32:57.201 DEBUG:teuthology.orchestra.run.trial099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T20:32:57.276 DEBUG:teuthology.orchestra.run.trial099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T20:32:57.340 INFO:teuthology.orchestra.run.trial099.stdout:check_obsoletes = 1 2026-02-12T20:32:57.341 DEBUG:teuthology.orchestra.run.trial099:> sudo yum clean all 2026-02-12T20:32:57.489 INFO:teuthology.orchestra.run.trial099.stdout:41 files removed 2026-02-12T20:32:57.503 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-radosgw 2026-02-12T20:32:57.781 INFO:teuthology.orchestra.run.trial099.stdout:ceph packages for x86_64 683 kB/s | 91 kB 00:00 2026-02-12T20:32:57.922 INFO:teuthology.orchestra.run.trial099.stdout:ceph noarch packages 205 kB/s | 24 kB 00:00 2026-02-12T20:32:58.048 INFO:teuthology.orchestra.run.trial099.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-12T20:32:58.897 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-12T20:33:02.240 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-12T20:33:05.700 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 7.8 MB 00:01 2026-02-12T20:33:07.334 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-12T20:33:08.226 INFO:teuthology.orchestra.run.trial099.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-12T20:33:11.448 INFO:teuthology.orchestra.run.trial099.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-12T20:33:12.747 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:12.748 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:12.748 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:12.748 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout:Upgrading: 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T20:33:12.749 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-12T20:33:12.750 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout:Installing weak dependencies: 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T20:33:12.751 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:12.752 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:12.752 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:12.752 INFO:teuthology.orchestra.run.trial099.stdout:Install 32 Packages 2026-02-12T20:33:12.752 INFO:teuthology.orchestra.run.trial099.stdout:Upgrade 2 Packages 2026-02-12T20:33:12.752 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:12.752 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 67 M 2026-02-12T20:33:12.753 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:14.267 INFO:teuthology.orchestra.run.trial099.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 4.8 MB/s | 5.2 MB 00:01 2026-02-12T20:33:14.280 INFO:teuthology.orchestra.run.trial099.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 1.8 MB/s | 25 kB 00:00 2026-02-12T20:33:14.340 INFO:teuthology.orchestra.run.trial099.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 15 MB/s | 909 kB 00:00 2026-02-12T20:33:14.360 INFO:teuthology.orchestra.run.trial099.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 12 MB/s | 248 kB 00:00 2026-02-12T20:33:14.700 INFO:teuthology.orchestra.run.trial099.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 8.7 MB/s | 13 MB 00:01 2026-02-12T20:33:14.730 INFO:teuthology.orchestra.run.trial099.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 1.4 MB/s | 45 kB 00:00 2026-02-12T20:33:14.744 INFO:teuthology.orchestra.run.trial099.stdout:(7/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_6 17 MB/s | 6.5 MB 00:00 2026-02-12T20:33:14.755 INFO:teuthology.orchestra.run.trial099.stdout:(8/34): python3-ceph-common-20.3.0-5230.gafefaa 7.4 MB/s | 185 kB 00:00 2026-02-12T20:33:14.767 INFO:teuthology.orchestra.run.trial099.stdout:(9/34): python3-cephfs-20.3.0-5230.gafefaa40.el 8.7 MB/s | 203 kB 00:00 2026-02-12T20:33:14.782 INFO:teuthology.orchestra.run.trial099.stdout:(10/34): python3-rados-20.3.0-5230.gafefaa40.el 12 MB/s | 324 kB 00:00 2026-02-12T20:33:14.796 INFO:teuthology.orchestra.run.trial099.stdout:(11/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 10 MB/s | 305 kB 00:00 2026-02-12T20:33:14.806 INFO:teuthology.orchestra.run.trial099.stdout:(12/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 4.1 MB/s | 100 kB 00:00 2026-02-12T20:33:14.821 INFO:teuthology.orchestra.run.trial099.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-12T20:33:14.842 INFO:teuthology.orchestra.run.trial099.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.5 MB/s | 93 kB 00:00 2026-02-12T20:33:14.932 INFO:teuthology.orchestra.run.trial099.stdout:(15/34): ceph-common-20.3.0-5230.gafefaa40.el9. 14 MB/s | 24 MB 00:01 2026-02-12T20:33:15.265 INFO:teuthology.orchestra.run.trial099.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 235 kB/s | 104 kB 00:00 2026-02-12T20:33:15.321 INFO:teuthology.orchestra.run.trial099.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 342 kB/s | 164 kB 00:00 2026-02-12T20:33:15.369 INFO:teuthology.orchestra.run.trial099.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 432 kB/s | 45 kB 00:00 2026-02-12T20:33:15.399 INFO:teuthology.orchestra.run.trial099.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 343 kB/s | 160 kB 00:00 2026-02-12T20:33:15.583 INFO:teuthology.orchestra.run.trial099.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-12T20:33:15.599 INFO:teuthology.orchestra.run.trial099.stdout:(21/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2026-02-12T20:33:15.601 INFO:teuthology.orchestra.run.trial099.stdout:(22/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2026-02-12T20:33:15.669 INFO:teuthology.orchestra.run.trial099.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 431 kB/s | 37 kB 00:00 2026-02-12T20:33:15.684 INFO:teuthology.orchestra.run.trial099.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 779 kB/s | 66 kB 00:00 2026-02-12T20:33:15.710 INFO:teuthology.orchestra.run.trial099.stdout:(25/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2026-02-12T20:33:15.737 INFO:teuthology.orchestra.run.trial099.stdout:(26/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 472 kB/s | 25 kB 00:00 2026-02-12T20:33:15.745 INFO:teuthology.orchestra.run.trial099.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-12T20:33:15.780 INFO:teuthology.orchestra.run.trial099.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2026-02-12T20:33:15.825 INFO:teuthology.orchestra.run.trial099.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 10 MB/s | 838 kB 00:00 2026-02-12T20:33:15.826 INFO:teuthology.orchestra.run.trial099.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 4.1 MB/s | 191 kB 00:00 2026-02-12T20:33:15.876 INFO:teuthology.orchestra.run.trial099.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2026-02-12T20:33:15.914 INFO:teuthology.orchestra.run.trial099.stdout:(32/34): libarrow-9.0.0-15.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2026-02-12T20:33:15.963 INFO:teuthology.orchestra.run.trial099.stdout:(33/34): librados2-20.3.0-5230.gafefaa40.el9.x8 25 MB/s | 3.5 MB 00:00 2026-02-12T20:33:15.976 INFO:teuthology.orchestra.run.trial099.stdout:(34/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 28 MB/s | 2.8 MB 00:00 2026-02-12T20:33:15.977 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:15.978 INFO:teuthology.orchestra.run.trial099.stdout:Total 21 MB/s | 67 MB 00:03 2026-02-12T20:33:16.072 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:16.088 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:16.088 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:16.349 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:16.350 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:16.649 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:16.800 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T20:33:16.806 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T20:33:16.837 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T20:33:16.877 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T20:33:16.878 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T20:33:16.891 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T20:33:16.900 INFO:teuthology.orchestra.run.trial099.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-12T20:33:16.902 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-12T20:33:16.906 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-12T20:33:16.910 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-12T20:33:16.924 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-12T20:33:16.936 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T20:33:16.937 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T20:33:16.960 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T20:33:16.964 INFO:teuthology.orchestra.run.trial099.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-12T20:33:16.999 INFO:teuthology.orchestra.run.trial099.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-12T20:33:17.003 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-12T20:33:17.010 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-12T20:33:17.012 INFO:teuthology.orchestra.run.trial099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-12T20:33:17.016 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-12T20:33:17.139 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T20:33:17.140 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T20:33:17.168 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T20:33:17.170 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-12T20:33:17.176 INFO:teuthology.orchestra.run.trial099.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T20:33:17.459 INFO:teuthology.orchestra.run.trial099.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T20:33:17.460 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T20:33:17.477 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T20:33:17.480 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-12T20:33:17.485 INFO:teuthology.orchestra.run.trial099.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T20:33:17.487 INFO:teuthology.orchestra.run.trial099.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T20:33:17.488 INFO:teuthology.orchestra.run.trial099.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T20:33:17.506 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T20:33:17.509 INFO:teuthology.orchestra.run.trial099.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T20:33:17.545 INFO:teuthology.orchestra.run.trial099.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T20:33:17.547 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-12T20:33:18.641 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T20:33:18.644 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T20:33:18.906 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T20:33:18.909 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T20:33:18.949 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T20:33:18.949 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T20:33:18.949 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T20:33:18.949 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:18.953 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T20:33:23.456 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T20:33:23.456 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /sys 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /proc 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /mnt 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /var/tmp 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /home 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /root 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /tmp 2026-02-12T20:33:23.457 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.035 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T20:33:24.058 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T20:33:24.058 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:33:24.059 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T20:33:24.059 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T20:33:24.059 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T20:33:24.059 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.060 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T20:33:24.073 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T20:33:24.073 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T20:33:24.128 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T20:33:24.128 INFO:teuthology.orchestra.run.trial099.stdout:Creating group 'qat' with GID 992. 2026-02-12T20:33:24.128 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.419 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-12T20:33:24.419 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T20:33:24.420 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T20:33:24.421 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-12T20:33:24.479 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T20:33:24.479 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.479 INFO:teuthology.orchestra.run.trial099.stdout:Upgraded: 2026-02-12T20:33:24.479 INFO:teuthology.orchestra.run.trial099.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T20:33:24.480 INFO:teuthology.orchestra.run.trial099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.481 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:24.523 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-test 2026-02-12T20:33:24.833 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:24.918 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:24.919 INFO:teuthology.orchestra.run.trial099.stdout:Install 10 Packages 2026-02-12T20:33:24.919 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:24.919 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 82 M 2026-02-12T20:33:24.919 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 339 M 2026-02-12T20:33:24.919 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:25.165 INFO:teuthology.orchestra.run.trial099.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 44 MB/s | 2.1 MB 00:00 2026-02-12T20:33:25.168 INFO:teuthology.orchestra.run.trial099.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 5.4 MB/s | 23 kB 00:00 2026-02-12T20:33:25.173 INFO:teuthology.orchestra.run.trial099.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 18 MB/s | 94 kB 00:00 2026-02-12T20:33:25.199 INFO:teuthology.orchestra.run.trial099.stdout:(4/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 1.9 MB/s | 159 kB 00:00 2026-02-12T20:33:25.222 INFO:teuthology.orchestra.run.trial099.stdout:(5/10): libxslt-1.1.34-12.el9.x86_64.rpm 4.7 MB/s | 233 kB 00:00 2026-02-12T20:33:25.240 INFO:teuthology.orchestra.run.trial099.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 17 MB/s | 303 kB 00:00 2026-02-12T20:33:25.249 INFO:teuthology.orchestra.run.trial099.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.9 MB/s | 64 kB 00:00 2026-02-12T20:33:25.261 INFO:teuthology.orchestra.run.trial099.stdout:(8/10): protobuf-3.14.0-17.el9.x86_64.rpm 16 MB/s | 1.0 MB 00:00 2026-02-12T20:33:25.590 INFO:teuthology.orchestra.run.trial099.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 357 kB/s | 122 kB 00:00 2026-02-12T20:33:26.777 INFO:teuthology.orchestra.run.trial099.stdout:(10/10): ceph-test-20.3.0-5230.gafefaa40.el9.x8 47 MB/s | 78 MB 00:01 2026-02-12T20:33:26.778 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:26.779 INFO:teuthology.orchestra.run.trial099.stdout:Total 44 MB/s | 82 MB 00:01 2026-02-12T20:33:26.843 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:26.853 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:26.853 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:27.136 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:27.136 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:27.444 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:27.453 INFO:teuthology.orchestra.run.trial099.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-12T20:33:27.462 INFO:teuthology.orchestra.run.trial099.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-12T20:33:27.467 INFO:teuthology.orchestra.run.trial099.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-12T20:33:27.471 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-12T20:33:27.476 INFO:teuthology.orchestra.run.trial099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-12T20:33:27.478 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-12T20:33:27.488 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-12T20:33:27.496 INFO:teuthology.orchestra.run.trial099.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-12T20:33:27.497 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T20:33:31.002 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T20:33:31.020 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T20:33:31.321 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-12T20:33:31.322 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T20:33:31.375 INFO:teuthology.orchestra.run.trial099.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:31.376 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:31.412 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph 2026-02-12T20:33:31.716 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:20 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:31.800 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:31.801 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:31.801 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:31.801 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-12T20:33:31.802 INFO:teuthology.orchestra.run.trial099.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T20:33:31.803 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-collections 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T20:33:31.804 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:31.805 INFO:teuthology.orchestra.run.trial099.stdout:Install 42 Packages 2026-02-12T20:33:31.806 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:31.806 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 48 M 2026-02-12T20:33:31.806 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 167 M 2026-02-12T20:33:31.806 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:32.524 INFO:teuthology.orchestra.run.trial099.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 130 kB/s | 6.5 kB 00:00 2026-02-12T20:33:32.679 INFO:teuthology.orchestra.run.trial099.stdout:(2/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 12 MB/s | 2.4 MB 00:00 2026-02-12T20:33:32.693 INFO:teuthology.orchestra.run.trial099.stdout:(3/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 4.2 MB/s | 936 kB 00:00 2026-02-12T20:33:32.707 INFO:teuthology.orchestra.run.trial099.stdout:(4/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 5.8 MB/s | 166 kB 00:00 2026-02-12T20:33:33.020 INFO:teuthology.orchestra.run.trial099.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 10 MB/s | 5.0 MB 00:00 2026-02-12T20:33:33.073 INFO:teuthology.orchestra.run.trial099.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 5.5 MB/s | 297 kB 00:00 2026-02-12T20:33:33.123 INFO:teuthology.orchestra.run.trial099.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 798 kB/s | 40 kB 00:00 2026-02-12T20:33:33.139 INFO:teuthology.orchestra.run.trial099.stdout:(8/42): libconfig-1.7.2-9.el9.x86_64.rpm 4.5 MB/s | 72 kB 00:00 2026-02-12T20:33:33.157 INFO:teuthology.orchestra.run.trial099.stdout:(9/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 13 MB/s | 253 kB 00:00 2026-02-12T20:33:33.193 INFO:teuthology.orchestra.run.trial099.stdout:(10/42): python3-cryptography-36.0.1-5.el9.x86_ 35 MB/s | 1.2 MB 00:00 2026-02-12T20:33:33.203 INFO:teuthology.orchestra.run.trial099.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 11 MB/s | 106 kB 00:00 2026-02-12T20:33:33.214 INFO:teuthology.orchestra.run.trial099.stdout:(12/42): python3-pycparser-2.20-6.el9.noarch.rp 13 MB/s | 135 kB 00:00 2026-02-12T20:33:33.224 INFO:teuthology.orchestra.run.trial099.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-12T20:33:33.235 INFO:teuthology.orchestra.run.trial099.stdout:(14/42): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-12T20:33:33.246 INFO:teuthology.orchestra.run.trial099.stdout:(15/42): python3-urllib3-1.26.5-7.el9.noarch.rp 19 MB/s | 218 kB 00:00 2026-02-12T20:33:33.257 INFO:teuthology.orchestra.run.trial099.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-12T20:33:33.267 INFO:teuthology.orchestra.run.trial099.stdout:(17/42): zip-3.0-35.el9.x86_64.rpm 26 MB/s | 266 kB 00:00 2026-02-12T20:33:33.526 INFO:teuthology.orchestra.run.trial099.stdout:(18/42): ceph-osd-crimson-20.3.0-5230.gafefaa40 23 MB/s | 19 MB 00:00 2026-02-12T20:33:34.004 INFO:teuthology.orchestra.run.trial099.stdout:(19/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 335 kB/s | 246 kB 00:00 2026-02-12T20:33:34.056 INFO:teuthology.orchestra.run.trial099.stdout:(20/42): ceph-osd-classic-20.3.0-5230.gafefaa40 11 MB/s | 16 MB 00:01 2026-02-12T20:33:34.181 INFO:teuthology.orchestra.run.trial099.stdout:(21/42): lua-5.4.4-4.el9.x86_64.rpm 288 kB/s | 188 kB 00:00 2026-02-12T20:33:34.246 INFO:teuthology.orchestra.run.trial099.stdout:(22/42): python3-libstoragemgmt-1.10.1-1.el9.x8 732 kB/s | 177 kB 00:00 2026-02-12T20:33:34.266 INFO:teuthology.orchestra.run.trial099.stdout:(23/42): python3-toml-0.10.2-6.el9.noarch.rpm 487 kB/s | 42 kB 00:00 2026-02-12T20:33:34.364 INFO:teuthology.orchestra.run.trial099.stdout:(24/42): lua-devel-5.4.4-4.el9.x86_64.rpm 188 kB/s | 22 kB 00:00 2026-02-12T20:33:34.433 INFO:teuthology.orchestra.run.trial099.stdout:(25/42): luarocks-3.9.2-5.el9.noarch.rpm 909 kB/s | 151 kB 00:00 2026-02-12T20:33:34.440 INFO:teuthology.orchestra.run.trial099.stdout:(26/42): python3-autocommand-2.2.2-8.el9.noarch 388 kB/s | 29 kB 00:00 2026-02-12T20:33:34.464 INFO:teuthology.orchestra.run.trial099.stdout:(27/42): python3-backports-tarfile-1.2.0-1.el9. 1.9 MB/s | 60 kB 00:00 2026-02-12T20:33:34.470 INFO:teuthology.orchestra.run.trial099.stdout:(28/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-12T20:33:34.504 INFO:teuthology.orchestra.run.trial099.stdout:(29/42): python3-cheroot-10.0.1-4.el9.noarch.rp 4.3 MB/s | 173 kB 00:00 2026-02-12T20:33:34.535 INFO:teuthology.orchestra.run.trial099.stdout:(30/42): python3-cherrypy-18.6.1-2.el9.noarch.r 5.4 MB/s | 358 kB 00:00 2026-02-12T20:33:34.535 INFO:teuthology.orchestra.run.trial099.stdout:(31/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 348 kB/s | 11 kB 00:00 2026-02-12T20:33:34.535 INFO:teuthology.orchestra.run.trial099.stdout:(32/42): python3-packaging-20.9-5.el9.noarch.rp 161 kB/s | 77 kB 00:00 2026-02-12T20:33:34.559 INFO:teuthology.orchestra.run.trial099.stdout:(33/42): python3-jaraco-classes-3.2.1-5.el9.noa 718 kB/s | 18 kB 00:00 2026-02-12T20:33:34.560 INFO:teuthology.orchestra.run.trial099.stdout:(34/42): python3-jaraco-collections-3.0.0-8.el9 932 kB/s | 23 kB 00:00 2026-02-12T20:33:34.560 INFO:teuthology.orchestra.run.trial099.stdout:(35/42): python3-jaraco-context-6.0.1-3.el9.noa 789 kB/s | 20 kB 00:00 2026-02-12T20:33:34.584 INFO:teuthology.orchestra.run.trial099.stdout:(36/42): python3-jaraco-functools-3.5.0-2.el9.n 789 kB/s | 19 kB 00:00 2026-02-12T20:33:34.585 INFO:teuthology.orchestra.run.trial099.stdout:(37/42): python3-jaraco-text-4.0.0-2.el9.noarch 1.0 MB/s | 26 kB 00:00 2026-02-12T20:33:34.587 INFO:teuthology.orchestra.run.trial099.stdout:(38/42): python3-more-itertools-8.12.0-2.el9.no 2.9 MB/s | 79 kB 00:00 2026-02-12T20:33:34.610 INFO:teuthology.orchestra.run.trial099.stdout:(39/42): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2026-02-12T20:33:34.612 INFO:teuthology.orchestra.run.trial099.stdout:(40/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.2 MB/s | 90 kB 00:00 2026-02-12T20:33:34.613 INFO:teuthology.orchestra.run.trial099.stdout:(41/42): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2026-02-12T20:33:34.636 INFO:teuthology.orchestra.run.trial099.stdout:(42/42): python3-zc-lockfile-2.0-10.el9.noarch. 789 kB/s | 20 kB 00:00 2026-02-12T20:33:34.639 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:34.639 INFO:teuthology.orchestra.run.trial099.stdout:Total 17 MB/s | 48 MB 00:02 2026-02-12T20:33:34.785 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:34.804 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:34.804 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:35.000 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:35.000 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:35.230 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:35.232 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-12T20:33:35.238 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-12T20:33:35.243 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-12T20:33:35.244 INFO:teuthology.orchestra.run.trial099.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-12T20:33:35.250 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-12T20:33:35.274 INFO:teuthology.orchestra.run.trial099.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-12T20:33:35.278 INFO:teuthology.orchestra.run.trial099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-12T20:33:35.282 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-12T20:33:35.287 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-12T20:33:35.293 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-12T20:33:35.297 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-12T20:33:35.303 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-12T20:33:35.308 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-12T20:33:35.312 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-12T20:33:35.317 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-12T20:33:35.321 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-12T20:33:35.328 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-12T20:33:35.331 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-12T20:33:35.354 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-12T20:33:35.366 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-12T20:33:35.371 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-12T20:33:35.381 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-12T20:33:35.388 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T20:33:35.401 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-12T20:33:35.417 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-12T20:33:35.492 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-12T20:33:35.501 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-12T20:33:35.524 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-12T20:33:35.553 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-12T20:33:35.559 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-12T20:33:35.611 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-12T20:33:35.653 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-12T20:33:35.654 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T20:33:35.676 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T20:33:35.676 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:33:35.676 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T20:33:35.676 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T20:33:35.676 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T20:33:35.677 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:35.681 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-12T20:33:35.698 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T20:33:35.698 INFO:teuthology.orchestra.run.trial099.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T20:33:35.698 INFO:teuthology.orchestra.run.trial099.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T20:33:35.698 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:35.707 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T20:33:35.732 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T20:33:35.732 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T20:33:35.732 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:36.369 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-12T20:33:37.130 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-12T20:33:37.140 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-12T20:33:37.141 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T20:33:37.167 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T20:33:37.167 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:33:37.167 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T20:33:37.167 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T20:33:37.167 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T20:33:37.167 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:37.379 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T20:33:37.400 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T20:33:37.401 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:33:37.401 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T20:33:37.401 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T20:33:37.401 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T20:33:37.401 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:37.495 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T20:33:37.516 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T20:33:37.516 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:33:37.516 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T20:33:37.516 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T20:33:37.517 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T20:33:37.517 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:37.517 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T20:33:37.525 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T20:33:37.550 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T20:33:37.933 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-12T20:33:37.934 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-12T20:33:37.935 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-12T20:33:37.991 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-12T20:33:37.991 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:37.991 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:37.991 INFO:teuthology.orchestra.run.trial099.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.991 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T20:33:37.992 INFO:teuthology.orchestra.run.trial099.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T20:33:37.993 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T20:33:37.994 INFO:teuthology.orchestra.run.trial099.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: zip-3.0-35.el9.x86_64 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:37.995 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:38.030 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-base 2026-02-12T20:33:38.337 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:38.402 INFO:teuthology.orchestra.run.trial099.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:33:38.419 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:38.420 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:33:38.420 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:38.442 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install cephadm 2026-02-12T20:33:38.743 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:38.825 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:38.826 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:38.826 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:33:38.826 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:38.826 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 1.0 M 2026-02-12T20:33:38.826 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 1.0 M 2026-02-12T20:33:38.826 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:38.982 INFO:teuthology.orchestra.run.trial099.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 6.5 MB/s | 1.0 MB 00:00 2026-02-12T20:33:38.982 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:38.982 INFO:teuthology.orchestra.run.trial099.stdout:Total 6.4 MB/s | 1.0 MB 00:00 2026-02-12T20:33:38.982 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:38.984 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:38.984 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:38.988 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:38.989 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:39.007 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:39.069 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T20:33:39.083 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T20:33:39.144 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T20:33:39.198 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T20:33:39.198 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:39.199 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:39.199 INFO:teuthology.orchestra.run.trial099.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:33:39.199 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:39.199 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:39.225 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T20:33:39.518 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:39.600 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repo Size 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:39.601 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:39.602 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:33:39.602 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:39.602 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 147 k 2026-02-12T20:33:39.602 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 419 k 2026-02-12T20:33:39.602 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:39.685 INFO:teuthology.orchestra.run.trial099.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 1.7 MB/s | 147 kB 00:00 2026-02-12T20:33:39.685 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:39.685 INFO:teuthology.orchestra.run.trial099.stdout:Total 1.7 MB/s | 147 kB 00:00 2026-02-12T20:33:39.685 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:39.689 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:39.689 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:39.716 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:39.716 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:39.765 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:39.766 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T20:33:39.788 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T20:33:39.789 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:33:39.789 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T20:33:39.789 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:40.063 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T20:33:40.063 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:40.064 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:40.064 INFO:teuthology.orchestra.run.trial099.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:33:40.064 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:40.064 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:40.093 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-mgr 2026-02-12T20:33:40.388 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:40.453 INFO:teuthology.orchestra.run.trial099.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:33:40.470 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:40.471 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:33:40.471 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:40.491 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T20:33:40.788 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:40.870 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:40.871 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:40.871 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:40.871 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T20:33:40.872 INFO:teuthology.orchestra.run.trial099.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout:Install 13 Packages 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:40.873 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 55 M 2026-02-12T20:33:40.874 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 262 M 2026-02-12T20:33:40.874 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:41.485 INFO:teuthology.orchestra.run.trial099.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 264 kB/s | 17 kB 00:00 2026-02-12T20:33:41.498 INFO:teuthology.orchestra.run.trial099.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5230.gaf 725 kB/s | 57 kB 00:00 2026-02-12T20:33:41.560 INFO:teuthology.orchestra.run.trial099.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 634 kB/s | 48 kB 00:00 2026-02-12T20:33:41.665 INFO:teuthology.orchestra.run.trial099.stdout:(4/13): python3-protobuf-3.14.0-17.el9.noarch.r 1.6 MB/s | 267 kB 00:00 2026-02-12T20:33:41.936 INFO:teuthology.orchestra.run.trial099.stdout:(5/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.0 MB/s | 551 kB 00:00 2026-02-12T20:33:41.972 INFO:teuthology.orchestra.run.trial099.stdout:(6/13): grpc-data-1.46.7-10.el9.noarch.rpm 542 kB/s | 19 kB 00:00 2026-02-12T20:33:42.093 INFO:teuthology.orchestra.run.trial099.stdout:(7/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 17 MB/s | 2.0 MB 00:00 2026-02-12T20:33:42.139 INFO:teuthology.orchestra.run.trial099.stdout:(8/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.1 MB/s | 144 kB 00:00 2026-02-12T20:33:42.175 INFO:teuthology.orchestra.run.trial099.stdout:(9/13): python3-repoze-lru-0.7-16.el9.noarch.rp 844 kB/s | 31 kB 00:00 2026-02-12T20:33:42.215 INFO:teuthology.orchestra.run.trial099.stdout:(10/13): python3-routes-2.5.1-5.el9.noarch.rpm 4.7 MB/s | 188 kB 00:00 2026-02-12T20:33:42.254 INFO:teuthology.orchestra.run.trial099.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 557 kB/s | 22 kB 00:00 2026-02-12T20:33:42.486 INFO:teuthology.orchestra.run.trial099.stdout:(12/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa 47 MB/s | 51 MB 00:01 2026-02-12T20:33:43.013 INFO:teuthology.orchestra.run.trial099.stdout:(13/13): protobuf-compiler-3.14.0-17.el9.x86_64 593 kB/s | 862 kB 00:01 2026-02-12T20:33:43.017 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:43.017 INFO:teuthology.orchestra.run.trial099.stdout:Total 26 MB/s | 55 MB 00:02 2026-02-12T20:33:43.043 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:43.052 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:43.052 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:43.263 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:43.263 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:43.489 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:43.494 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-12T20:33:43.505 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-12T20:33:43.507 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-12T20:33:43.535 INFO:teuthology.orchestra.run.trial099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-12T20:33:43.578 INFO:teuthology.orchestra.run.trial099.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-12T20:33:43.588 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-12T20:33:43.615 INFO:teuthology.orchestra.run.trial099.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-12T20:33:43.625 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-12T20:33:43.632 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-12T20:33:43.635 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-12T20:33:43.644 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-12T20:33:46.508 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-12T20:33:46.514 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-12T20:33:46.780 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-12T20:33:46.781 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-12T20:33:46.781 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-12T20:33:46.781 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-12T20:33:46.781 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:46.834 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:46.870 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T20:33:47.169 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout:======================================================================================= 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout:======================================================================================= 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T20:33:47.252 INFO:teuthology.orchestra.run.trial099.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout:======================================================================================= 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout:Install 12 Packages 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 43 M 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 234 M 2026-02-12T20:33:47.253 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:33:47.752 INFO:teuthology.orchestra.run.trial099.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 557 kB/s | 184 kB 00:00 2026-02-12T20:33:47.763 INFO:teuthology.orchestra.run.trial099.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 3.0 MB/s | 33 kB 00:00 2026-02-12T20:33:47.790 INFO:teuthology.orchestra.run.trial099.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 112 MB/s | 3.0 MB 00:00 2026-02-12T20:33:47.794 INFO:teuthology.orchestra.run.trial099.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 4.5 MB/s | 18 kB 00:00 2026-02-12T20:33:47.798 INFO:teuthology.orchestra.run.trial099.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 10 MB/s | 42 kB 00:00 2026-02-12T20:33:47.818 INFO:teuthology.orchestra.run.trial099.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 265 MB/s | 5.3 MB 00:00 2026-02-12T20:33:47.826 INFO:teuthology.orchestra.run.trial099.stdout:(7/12): python3-devel-3.9.25-2.el9.x86_64.rpm 34 MB/s | 244 kB 00:00 2026-02-12T20:33:47.839 INFO:teuthology.orchestra.run.trial099.stdout:(8/12): libgfortran-11.5.0-14.el9.x86_64.rpm 1.9 MB/s | 794 kB 00:00 2026-02-12T20:33:47.851 INFO:teuthology.orchestra.run.trial099.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 240 MB/s | 6.1 MB 00:00 2026-02-12T20:33:47.864 INFO:teuthology.orchestra.run.trial099.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-12T20:33:47.911 INFO:teuthology.orchestra.run.trial099.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 325 MB/s | 19 MB 00:00 2026-02-12T20:33:48.061 INFO:teuthology.orchestra.run.trial099.stdout:(12/12): ceph-mgr-diskprediction-local-20.3.0-5 12 MB/s | 7.4 MB 00:00 2026-02-12T20:33:48.062 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:33:48.063 INFO:teuthology.orchestra.run.trial099.stdout:Total 53 MB/s | 43 MB 00:00 2026-02-12T20:33:48.222 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:33:48.235 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:33:48.236 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:33:48.438 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:33:48.438 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:33:48.655 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:33:48.658 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-12T20:33:48.664 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-12T20:33:48.697 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-12T20:33:48.703 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-12T20:33:48.762 INFO:teuthology.orchestra.run.trial099.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-12T20:33:48.764 INFO:teuthology.orchestra.run.trial099.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-12T20:33:48.785 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-12T20:33:49.105 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-12T20:33:49.177 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-12T20:33:49.840 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T20:33:50.300 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-12T20:33:50.301 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T20:33:50.589 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T20:33:50.589 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-12T20:33:50.589 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-12T20:33:50.589 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-12T20:33:50.589 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-12T20:33:50.589 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-12T20:33:50.590 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-12T20:33:50.590 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-12T20:33:50.590 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-12T20:33:50.590 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-12T20:33:50.590 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T20:33:50.590 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-12T20:33:50.648 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-12T20:33:50.648 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T20:33:50.649 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T20:33:50.650 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T20:33:50.650 INFO:teuthology.orchestra.run.trial099.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T20:33:50.650 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:50.650 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:33:50.690 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-mgr-rook 2026-02-12T20:33:50.992 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:33:51.074 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:33:51.075 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T20:33:51.076 INFO:teuthology.orchestra.run.trial099.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout:Install 10 Packages 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 2.0 M 2026-02-12T20:33:51.077 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 25 M 2026-02-12T20:33:51.078 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:00.632 INFO:teuthology.orchestra.run.trial099.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 577 kB/s | 50 kB 00:00 2026-02-12T20:36:01.115 INFO:teuthology.orchestra.run.trial099.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 111 kB/s | 54 kB 00:00 2026-02-12T20:36:01.193 INFO:teuthology.orchestra.run.trial099.stdout:(3/10): python3-cachetools-4.2.4-1.el9.noarch.r 413 kB/s | 32 kB 00:00 2026-02-12T20:36:01.217 INFO:teuthology.orchestra.run.trial099.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 582 kB/s | 14 kB 00:00 2026-02-12T20:36:01.288 INFO:teuthology.orchestra.run.trial099.stdout:(5/10): python3-google-auth-2.45.0-1.el9.noarch 3.5 MB/s | 254 kB 00:00 2026-02-12T20:36:01.338 INFO:teuthology.orchestra.run.trial099.stdout:(6/10): python3-pyasn1-modules-0.4.8-6.el9.noar 351 kB/s | 279 kB 00:00 2026-02-12T20:36:01.373 INFO:teuthology.orchestra.run.trial099.stdout:(7/10): python3-kubernetes-26.1.0-3.el9.noarch. 12 MB/s | 1.0 MB 00:00 2026-02-12T20:36:01.399 INFO:teuthology.orchestra.run.trial099.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 3.5 MB/s | 90 kB 00:00 2026-02-12T20:36:01.429 INFO:teuthology.orchestra.run.trial099.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 647 kB/s | 59 kB 00:00 2026-02-12T20:36:01.563 INFO:teuthology.orchestra.run.trial099.stdout:(10/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 156 kB/s | 159 kB 00:01 2026-02-12T20:36:01.566 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:01.566 INFO:teuthology.orchestra.run.trial099.stdout:Total 16 kB/s | 2.0 MB 02:10 2026-02-12T20:36:01.590 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:01.598 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:01.598 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:01.638 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:01.638 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:01.713 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:01.763 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-12T20:36:01.776 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-12T20:36:01.791 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-12T20:36:01.795 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-12T20:36:01.803 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-12T20:36:01.842 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-12T20:36:01.854 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T20:36:02.175 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-12T20:36:02.190 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-12T20:36:02.190 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T20:36:02.299 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T20:36:02.299 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-12T20:36:02.299 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-12T20:36:02.299 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-12T20:36:02.299 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-12T20:36:02.299 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-12T20:36:02.300 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-12T20:36:02.300 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T20:36:02.300 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-12T20:36:02.300 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T20:36:02.355 INFO:teuthology.orchestra.run.trial099.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:02.356 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:02.384 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T20:36:02.689 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:51 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:02.771 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T20:36:02.772 INFO:teuthology.orchestra.run.trial099.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout:Install 7 Packages 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 7.1 M 2026-02-12T20:36:02.773 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 34 M 2026-02-12T20:36:02.774 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:03.592 INFO:teuthology.orchestra.run.trial099.stdout:(1/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 2.0 MB/s | 184 kB 00:00 2026-02-12T20:36:03.594 INFO:teuthology.orchestra.run.trial099.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.7 MB/s | 249 kB 00:00 2026-02-12T20:36:03.655 INFO:teuthology.orchestra.run.trial099.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 546 kB/s | 35 kB 00:00 2026-02-12T20:36:03.705 INFO:teuthology.orchestra.run.trial099.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2026-02-12T20:36:03.915 INFO:teuthology.orchestra.run.trial099.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 222 kB/s | 58 kB 00:00 2026-02-12T20:36:03.917 INFO:teuthology.orchestra.run.trial099.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 409 kB/s | 86 kB 00:00 2026-02-12T20:36:04.041 INFO:teuthology.orchestra.run.trial099.stdout:(7/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2026-02-12T20:36:04.041 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:04.042 INFO:teuthology.orchestra.run.trial099.stdout:Total 5.6 MB/s | 7.1 MB 00:01 2026-02-12T20:36:04.082 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:04.088 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:04.088 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:04.160 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:04.160 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:04.248 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:04.298 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-12T20:36:04.308 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-12T20:36:04.314 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-12T20:36:04.534 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T20:36:04.557 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-12T20:36:04.582 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-12T20:36:04.583 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-12T20:36:04.696 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T20:36:04.752 INFO:teuthology.orchestra.run.trial099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T20:36:04.753 INFO:teuthology.orchestra.run.trial099.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T20:36:04.753 INFO:teuthology.orchestra.run.trial099.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T20:36:04.753 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:04.753 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:04.784 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-osd 2026-02-12T20:36:05.086 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:54 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:05.152 INFO:teuthology.orchestra.run.trial099.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:05.170 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:05.171 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:05.171 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:05.192 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-osd-classic 2026-02-12T20:36:05.496 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:54 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:05.561 INFO:teuthology.orchestra.run.trial099.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:05.579 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:05.580 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:05.580 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:05.602 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-fuse 2026-02-12T20:36:05.897 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:54 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:05.979 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:05.980 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:05.980 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repo Size 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 987 k 2026-02-12T20:36:05.981 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 2.9 M 2026-02-12T20:36:05.982 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:06.097 INFO:teuthology.orchestra.run.trial099.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 8.3 MB/s | 987 kB 00:00 2026-02-12T20:36:06.098 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:06.098 INFO:teuthology.orchestra.run.trial099.stdout:Total 8.2 MB/s | 987 kB 00:00 2026-02-12T20:36:06.098 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:06.102 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:06.102 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:06.138 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:06.138 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:06.230 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:06.246 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:06.484 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:06.540 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:06.540 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:06.540 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:06.540 INFO:teuthology.orchestra.run.trial099.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:06.540 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:06.540 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:06.566 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-volume 2026-02-12T20:36:06.868 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:55 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:06.951 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:06.952 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:06.952 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-12T20:36:06.952 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout:Install 2 Packages 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:06.953 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 649 k 2026-02-12T20:36:06.954 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 2.2 M 2026-02-12T20:36:06.954 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:07.412 INFO:teuthology.orchestra.run.trial099.stdout:(1/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 3.1 MB/s | 299 kB 00:00 2026-02-12T20:36:08.125 INFO:teuthology.orchestra.run.trial099.stdout:(2/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 434 kB/s | 350 kB 00:00 2026-02-12T20:36:08.125 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:08.126 INFO:teuthology.orchestra.run.trial099.stdout:Total 554 kB/s | 649 kB 00:01 2026-02-12T20:36:08.134 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:08.140 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:08.140 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:08.184 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:08.184 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:08.264 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:08.326 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-12T20:36:08.328 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T20:36:08.344 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T20:36:08.344 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:36:08.344 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T20:36:08.344 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:08.567 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-12T20:36:08.623 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-12T20:36:08.623 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:08.623 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:08.623 INFO:teuthology.orchestra.run.trial099.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T20:36:08.623 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:08.624 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:08.652 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install librados-devel 2026-02-12T20:36:08.960 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:57 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:09.042 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:09.043 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:09.043 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repo Size 2026-02-12T20:36:09.043 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 123 k 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 437 k 2026-02-12T20:36:09.044 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:09.127 INFO:teuthology.orchestra.run.trial099.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-12T20:36:09.128 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:09.128 INFO:teuthology.orchestra.run.trial099.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-12T20:36:09.128 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:09.131 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:09.131 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:09.162 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:09.162 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:09.216 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:09.232 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:09.310 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:09.367 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:09.367 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:09.367 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:09.367 INFO:teuthology.orchestra.run.trial099.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:09.367 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:09.367 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:09.395 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install libcephfs2 2026-02-12T20:36:09.699 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:58 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:09.763 INFO:teuthology.orchestra.run.trial099.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:09.782 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:09.782 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:09.782 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:09.804 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install libcephfs-devel 2026-02-12T20:36:10.104 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:02:59 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:10.186 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:10.186 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repo Size 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Install 2 Packages 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 62 k 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 223 k 2026-02-12T20:36:10.187 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:10.440 INFO:teuthology.orchestra.run.trial099.stdout:(1/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 148 kB/s | 37 kB 00:00 2026-02-12T20:36:10.441 INFO:teuthology.orchestra.run.trial099.stdout:(2/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 98 kB/s | 25 kB 00:00 2026-02-12T20:36:10.444 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:10.444 INFO:teuthology.orchestra.run.trial099.stdout:Total 241 kB/s | 62 kB 00:00 2026-02-12T20:36:10.445 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:10.447 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:10.448 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:10.480 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:10.480 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:10.528 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:10.529 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T20:36:10.546 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T20:36:10.562 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T20:36:10.618 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T20:36:10.618 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T20:36:10.674 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T20:36:10.674 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:10.674 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:10.674 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:10.674 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:10.675 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:10.675 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:10.702 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install librados2 2026-02-12T20:36:11.001 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:00 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:11.066 INFO:teuthology.orchestra.run.trial099.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:11.084 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:11.085 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:11.085 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:11.107 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install librbd1 2026-02-12T20:36:11.404 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:00 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:11.469 INFO:teuthology.orchestra.run.trial099.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:11.487 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:11.488 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:11.488 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:11.510 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install python3-rados 2026-02-12T20:36:11.810 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:00 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:11.876 INFO:teuthology.orchestra.run.trial099.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:11.894 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:11.895 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:11.895 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:11.917 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install python3-rgw 2026-02-12T20:36:12.219 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:01 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:12.283 INFO:teuthology.orchestra.run.trial099.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:12.301 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:12.302 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:12.302 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:12.324 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install python3-cephfs 2026-02-12T20:36:12.625 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:01 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:12.689 INFO:teuthology.orchestra.run.trial099.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:12.708 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:12.708 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:12.709 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:12.729 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install python3-rbd 2026-02-12T20:36:13.032 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:02 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:13.097 INFO:teuthology.orchestra.run.trial099.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T20:36:13.116 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:13.116 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-12T20:36:13.117 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:13.138 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install rbd-fuse 2026-02-12T20:36:13.440 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:02 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout: Package Architecture Version Repository Size 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 84 k 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 209 k 2026-02-12T20:36:13.523 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:13.597 INFO:teuthology.orchestra.run.trial099.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-12T20:36:13.598 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:13.598 INFO:teuthology.orchestra.run.trial099.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-12T20:36:13.598 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:13.602 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:13.602 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:13.633 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:13.634 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:13.684 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:13.700 INFO:teuthology.orchestra.run.trial099.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:13.785 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:13.841 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:13.842 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:13.842 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:13.842 INFO:teuthology.orchestra.run.trial099.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:13.842 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:13.842 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:13.870 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install rbd-mirror 2026-02-12T20:36:14.175 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:03 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:14.258 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:14.259 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:14.259 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repo Size 2026-02-12T20:36:14.259 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 2.9 M 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 11 M 2026-02-12T20:36:14.260 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:14.403 INFO:teuthology.orchestra.run.trial099.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-12T20:36:14.404 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:14.404 INFO:teuthology.orchestra.run.trial099.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-12T20:36:14.404 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:14.409 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:14.409 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:14.449 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:14.449 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:14.630 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:14.631 INFO:teuthology.orchestra.run.trial099.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:14.654 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:14.654 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T20:36:14.654 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T20:36:14.654 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T20:36:14.655 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T20:36:14.655 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:14.939 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:14.939 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:14.939 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:14.939 INFO:teuthology.orchestra.run.trial099.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:14.939 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:14.939 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:14.967 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install rbd-nbd 2026-02-12T20:36:15.272 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:03:04 ago on Thu 12 Feb 2026 08:33:11 PM UTC. 2026-02-12T20:36:15.354 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout: Package Architecture Version Repository Size 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-12T20:36:15.356 INFO:teuthology.orchestra.run.trial099.stdout:Install 1 Package 2026-02-12T20:36:15.357 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:15.357 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 172 k 2026-02-12T20:36:15.357 INFO:teuthology.orchestra.run.trial099.stdout:Installed size: 462 k 2026-02-12T20:36:15.357 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-12T20:36:15.440 INFO:teuthology.orchestra.run.trial099.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-12T20:36:15.441 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-12T20:36:15.441 INFO:teuthology.orchestra.run.trial099.stdout:Total 2.0 MB/s | 172 kB 00:00 2026-02-12T20:36:15.441 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-12T20:36:15.445 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-12T20:36:15.446 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-12T20:36:15.478 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-12T20:36:15.478 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-12T20:36:15.535 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-12T20:36:15.552 INFO:teuthology.orchestra.run.trial099.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:15.634 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:15.692 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T20:36:15.692 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:15.692 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-12T20:36:15.692 INFO:teuthology.orchestra.run.trial099.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T20:36:15.692 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-12T20:36:15.692 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-12T20:36:15.728 DEBUG:teuthology.parallel:result is None 2026-02-12T20:36:15.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T20:36:15.894 DEBUG:teuthology.orchestra.run.trial099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T20:36:15.915 INFO:teuthology.orchestra.run.trial099.stdout:20.3.0-5230.gafefaa40.el9 2026-02-12T20:36:15.916 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-12T20:36:15.916 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-12T20:36:15.918 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T20:36:15.919 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:36:15.919 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T20:36:15.982 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T20:36:15.982 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:36:15.983 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T20:36:16.046 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T20:36:16.110 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T20:36:16.110 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:36:16.111 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T20:36:16.174 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T20:36:16.238 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T20:36:16.238 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:36:16.238 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T20:36:16.302 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T20:36:16.366 INFO:teuthology.run_tasks:Running task workunit... 2026-02-12T20:36:16.396 INFO:tasks.workunit:Pulling workunits from ref afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T20:36:16.397 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-12T20:36:16.397 INFO:tasks.workunit:timeout=3h 2026-02-12T20:36:16.397 INFO:tasks.workunit:cleanup=True 2026-02-12T20:36:16.397 DEBUG:teuthology.orchestra.run.trial099:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-12T20:36:16.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T20:36:16.423 INFO:teuthology.orchestra.run.trial099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-12T20:36:16.424 DEBUG:teuthology.orchestra.run.trial099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T20:36:16.479 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-12T20:36:16.479 DEBUG:teuthology.orchestra.run.trial099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-12T20:36:16.536 DEBUG:teuthology.orchestra.run.trial099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T20:36:16.601 INFO:tasks.workunit.client.0.trial099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-12T20:36:35.816 INFO:tasks.workunit.client.0.trial099.stderr:Note: switching to 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'. 2026-02-12T20:36:35.816 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr:state without impacting any branches by switching back to a branch. 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr: git switch -c 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr:Or undo this operation with: 2026-02-12T20:36:35.817 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.818 INFO:tasks.workunit.client.0.trial099.stderr: git switch - 2026-02-12T20:36:35.818 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.818 INFO:tasks.workunit.client.0.trial099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-12T20:36:35.818 INFO:tasks.workunit.client.0.trial099.stderr: 2026-02-12T20:36:35.818 INFO:tasks.workunit.client.0.trial099.stderr:HEAD is now at afefaa40503 Merge branch 'block_non_4k_chunks' of https://github.com/aainscow/ceph into wip-yuri4-testing-2026-02-11-2126 2026-02-12T20:36:35.824 DEBUG:teuthology.orchestra.run.trial099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-12T20:36:35.882 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-12T20:36:35.883 DEBUG:teuthology.orchestra.run.trial099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-12T20:36:35.940 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-12T20:36:35.941 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-12T20:36:35.941 DEBUG:teuthology.orchestra.run.trial099:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-12T20:36:36.004 INFO:tasks.workunit.client.0.trial099.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-12T20:36:36.021 INFO:tasks.workunit.client.0.trial099.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-12T20:36:36.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/bad-inc-map 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:42773 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:42773 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none ' 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:42773 ' 2026-02-12T20:36:36.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-12T20:36:36.025 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-12T20:36:36.025 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-12T20:36:36.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-12T20:36:36.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-12T20:36:36.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-12T20:36:36.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:36:36.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:36:36.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:36:36.027 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:36:36.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:36:36.027 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:36:36.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:36:36.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:36:36.028 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:36:36.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:36.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:36:36.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:36:36.029 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:36.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:36:36.030 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:36:36.030 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-12T20:36:36.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:36:36.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18045 2026-02-12T20:36:36.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:36:36.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:36:36.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-12T20:36:36.033 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:36:36.033 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.033 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.033 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.18045 2026-02-12T20:36:36.034 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:36:36.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-12T20:36:36.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-12T20:36:36.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-12T20:36:36.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:36:36.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:36.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:36.064 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:36.064 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.064 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:36.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:36:36.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:36:36.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:36:36.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:36:36.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18045/ceph-mon.a.asok 2026-02-12T20:36:36.090 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:36:36.090 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18045/ceph-mon.a.asok config get fsid 2026-02-12T20:36:36.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:36:36.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:36:36.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:36:36.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:36:36.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:36:36.131 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:36:36.132 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:36:36.132 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:36:36.132 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:36:36.133 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.133 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.133 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.18045/ceph-mon.a.asok 2026-02-12T20:36:36.133 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:36:36.133 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.18045/ceph-mon.a.asok config get mon_host 2026-02-12T20:36:36.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-12T20:36:36.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-12T20:36:36.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:36:36.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:36:36.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:36:36.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-12T20:36:36.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:36:36.271 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:36:36.271 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:36.272 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:36.272 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:36.272 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.272 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.272 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:36.273 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:36:36.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 ' 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:36:36.290 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:36.291 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:36:36.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-12T20:36:36.293 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:36:36.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=14a7c742-9228-4c00-8a6f-e194bda49d73 2026-02-12T20:36:36.293 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 14a7c742-9228-4c00-8a6f-e194bda49d73 2026-02-12T20:36:36.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 14a7c742-9228-4c00-8a6f-e194bda49d73' 2026-02-12T20:36:36.294 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:36:36.298 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUOY5pQ6lOEhAAsjUGJVDyWKhOASzYdF3jfQ== 2026-02-12T20:36:36.298 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUOY5pQ6lOEhAAsjUGJVDyWKhOASzYdF3jfQ=="}' 2026-02-12T20:36:36.298 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 14a7c742-9228-4c00-8a6f-e194bda49d73 -i td/bad-inc-map/0/new.json 2026-02-12T20:36:36.396 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:36.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-12T20:36:36.404 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUOY5pQ6lOEhAAsjUGJVDyWKhOASzYdF3jfQ== --osd-uuid 14a7c742-9228-4c00-8a6f-e194bda49d73 2026-02-12T20:36:36.418 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.427+0000 7f9cff651780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:36.420 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.429+0000 7f9cff651780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:36.421 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.429+0000 7f9cff651780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:36.421 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.430+0000 7f9cff651780 -1 bdev(0x2b04c00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:36:36.421 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.430+0000 7f9cff651780 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-12T20:36:36.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-12T20:36:36.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:36:36.821 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:36:36.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:36:36.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:36:36.921 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:36:36.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:36:36.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:36:36.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:36:36.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:36:36.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:36:36.935 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.943+0000 7fa0d4a3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:36.936 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.945+0000 7fa0d4a3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:36.937 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:36.946+0000 7fa0d4a3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:37.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:36:37.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:37.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:36:37.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:37.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:37.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:37.016 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:37.016 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:37.016 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:37.016 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:36:37.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:36:37.153 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:37.162+0000 7fa0d4a3b780 -1 Falling back to public interface 2026-02-12T20:36:37.455 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:37.464+0000 7fa0d4a3b780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:36:38.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:36:38.110 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:38.110 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:36:38.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:36:38.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:38.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:36:38.203 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4169873868,v1:127.0.0.1:6801/4169873868] [v2:127.0.0.1:6802/4169873868,v1:127.0.0.1:6803/4169873868] exists,up 14a7c742-9228-4c00-8a6f-e194bda49d73 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:36:38.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 ' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-12T20:36:38.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-12T20:36:38.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d54ebf67-e701-4d92-88f6-3d894cbfe2ec 2026-02-12T20:36:38.210 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 d54ebf67-e701-4d92-88f6-3d894cbfe2ec 2026-02-12T20:36:38.211 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d54ebf67-e701-4d92-88f6-3d894cbfe2ec' 2026-02-12T20:36:38.211 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:36:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDWOY5pxgVvDRAAh5gaXmksc6C0mZKpi2KlvA== 2026-02-12T20:36:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDWOY5pxgVvDRAAh5gaXmksc6C0mZKpi2KlvA=="}' 2026-02-12T20:36:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d54ebf67-e701-4d92-88f6-3d894cbfe2ec -i td/bad-inc-map/1/new.json 2026-02-12T20:36:38.320 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:36:38.326 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-12T20:36:38.327 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDWOY5pxgVvDRAAh5gaXmksc6C0mZKpi2KlvA== --osd-uuid d54ebf67-e701-4d92-88f6-3d894cbfe2ec 2026-02-12T20:36:38.342 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:38.351+0000 7fc3f542d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:38.344 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:38.353+0000 7fc3f542d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:38.345 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:38.353+0000 7fc3f542d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:38.345 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:38.354+0000 7fc3f542d780 -1 bdev(0x2b38c00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:36:38.345 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:38.354+0000 7fc3f542d780 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-12T20:36:38.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-12T20:36:38.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:36:38.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:36:38.769 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:36:38.770 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:36:39.082 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:36:39.082 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:36:39.083 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:36:39.083 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:36:39.083 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:36:39.084 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:36:39.096 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:39.105+0000 7fc335008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:39.097 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:39.106+0000 7fc335008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:39.098 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:39.107+0000 7fc335008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:39.231 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:39.239+0000 7fc335008780 -1 Falling back to public interface 2026-02-12T20:36:39.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:36:39.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:39.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:36:39.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:39.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:39.304 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:39.304 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:39.304 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:39.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:39.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:36:39.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:36:39.552 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:39.560+0000 7fc335008780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:36:40.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:36:40.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:40.527 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:36:40.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:36:40.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:40.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:36:40.755 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3570773086,v1:127.0.0.1:6811/3570773086] [v2:127.0.0.1:6812/3570773086,v1:127.0.0.1:6813/3570773086] exists,up d54ebf67-e701-4d92-88f6-3d894cbfe2ec 2026-02-12T20:36:40.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:40.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:40.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 ' 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-12T20:36:40.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' 2026-02-12T20:36:40.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:36:40.762 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=856036ad-9aa4-4903-ba1a-e0b55b3d878e 2026-02-12T20:36:40.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 856036ad-9aa4-4903-ba1a-e0b55b3d878e' 2026-02-12T20:36:40.763 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 856036ad-9aa4-4903-ba1a-e0b55b3d878e 2026-02-12T20:36:40.763 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:36:40.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDYOY5pPutWLhAA++tg+HgGHAGKkziV0Kt/eA== 2026-02-12T20:36:40.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDYOY5pPutWLhAA++tg+HgGHAGKkziV0Kt/eA=="}' 2026-02-12T20:36:40.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 856036ad-9aa4-4903-ba1a-e0b55b3d878e -i td/bad-inc-map/2/new.json 2026-02-12T20:36:40.997 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:36:41.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-12T20:36:41.005 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDYOY5pPutWLhAA++tg+HgGHAGKkziV0Kt/eA== --osd-uuid 856036ad-9aa4-4903-ba1a-e0b55b3d878e 2026-02-12T20:36:41.020 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.028+0000 7fe12722d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:41.021 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.030+0000 7fe12722d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:41.022 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.031+0000 7fe12722d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:41.023 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.031+0000 7fe12722d780 -1 bdev(0x3458c00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:36:41.023 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.031+0000 7fe12722d780 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-12T20:36:41.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-12T20:36:41.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:36:41.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:36:41.343 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:36:41.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:36:41.669 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:36:41.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:36:41.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=8beaf5c6-ad72-4911-ab67-9feebd7e6c68 --auth-supported=none --mon-host=127.0.0.1:42773 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.18045/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:36:41.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:36:41.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:36:41.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:36:41.684 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.693+0000 7f6f72257780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:41.685 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.694+0000 7f6f72257780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:41.686 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.695+0000 7f6f72257780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:41.854 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:41.862+0000 7f6f72257780 -1 Falling back to public interface 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:41.893 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:41.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:41.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:36:42.117 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:36:42.216 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:42.224+0000 7f6f72257780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:36:43.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:36:43.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:43.119 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:36:43.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:36:43.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:43.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:36:43.340 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4182559609,v1:127.0.0.1:6819/4182559609] [v2:127.0.0.1:6820/4182559609,v1:127.0.0.1:6821/4182559609] exists,up 856036ad-9aa4-4903-ba1a-e0b55b3d878e 2026-02-12T20:36:43.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:43.341 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:43.341 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:43.341 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-12T20:36:43.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-12T20:36:43.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-12T20:36:43.839 INFO:tasks.workunit.client.0.trial099.stderr:pool 'foo' already exists 2026-02-12T20:36:43.847 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:36:44.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-12T20:36:45.162 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 min_size to 1 2026-02-12T20:36:45.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-12T20:36:45.467 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 min_size to 2 2026-02-12T20:36:45.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-12T20:36:50.478 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:50.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:50.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:50.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:36:50.709 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4169873868,v1:127.0.0.1:6801/4169873868] [v2:127.0.0.1:6802/4169873868,v1:127.0.0.1:6803/4169873868] exists,up 14a7c742-9228-4c00-8a6f-e194bda49d73 2026-02-12T20:36:50.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:50.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 9 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3570773086,v1:127.0.0.1:6811/3570773086] [v2:127.0.0.1:6812/3570773086,v1:127.0.0.1:6813/3570773086] exists,up d54ebf67-e701-4d92-88f6-3d894cbfe2ec 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:36:50.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:50.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:50.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-12T20:36:50.936 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:50.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:50.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:50.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:36:51.160 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 13 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4182559609,v1:127.0.0.1:6819/4182559609] [v2:127.0.0.1:6820/4182559609,v1:127.0.0.1:6821/4182559609] exists,up 856036ad-9aa4-4903-ba1a-e0b55b3d878e 2026-02-12T20:36:51.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:51.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:51.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:51.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:43.785+0000 7f6f60e0e640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:43.890+0000 7f6f60e0e640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:43.991+0000 7f6f60e0e640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.069+0000 7f6f5ee0a640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.070+0000 7f6f5ee0a640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.171+0000 7f6f60e0e640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.171+0000 7f6f60e0e640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.374+0000 7f6f5ee0a640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.476+0000 7f6f60e0e640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.162 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.476+0000 7f6f5ee0a640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-12T20:36:51.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-12T20:36:51.163 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:43.785+0000 7f6f60e0e640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-12T20:36:51.163 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:43.890+0000 7f6f60e0e640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-12T20:36:51.163 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:43.992+0000 7f6f60e0e640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.069+0000 7f6f5ee0a640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.070+0000 7f6f5ee0a640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.171+0000 7f6f60e0e640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.172+0000 7f6f60e0e640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.374+0000 7f6f5ee0a640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.476+0000 7f6f60e0e640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:36:45.476+0000 7f6f5ee0a640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-12T20:36:51.164 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-12T20:36:51.165 INFO:tasks.workunit.client.0.trial099.stdout:success 2026-02-12T20:36:51.165 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-12T20:36:51.165 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-12T20:36:51.165 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-12T20:36:51.464 INFO:tasks.workunit.client.0.trial099.stderr:pool 'foo' does not exist 2026-02-12T20:36:51.472 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-12T20:36:51.473 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:36:51.473 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:36:51.473 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:36:51.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:36:51.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:36:56.787 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:36:56.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:36:56.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:36:56.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:36:56.792 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:36:56.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:36:56.793 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:36:56.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:36:56.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:36:56.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:36:56.795 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:36:56.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:56.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:36:56.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:36:56.796 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:56.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:36:56.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:36:56.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-12T20:36:56.805 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:36:56.805 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:56.805 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:56.805 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18045 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/bad-inc-map 0 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:36:56.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:36:56.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:36:56.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:36:56.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:36:56.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:36:56.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:36:56.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:36:56.809 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:36:56.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:36:56.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:36:56.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:36:56.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:56.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:36:56.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:36:56.812 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:56.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:36:56.813 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-12T20:36:56.813 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-12T20:36:56.814 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:36:56.814 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:56.814 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.18045 2026-02-12T20:36:56.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.18045 2026-02-12T20:36:56.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:36:56.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:36:56.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-12T20:36:56.816 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T20:36:56.816 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T20:36:56.881 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-12T20:36:56.881 DEBUG:teuthology.orchestra.run.trial099:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-12T20:36:56.942 INFO:tasks.workunit.client.0.trial099.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-12T20:36:56.946 INFO:tasks.workunit.client.0.trial099.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-12T20:36:56.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/divergent-priors 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-12T20:36:56.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-12T20:36:56.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-12T20:36:56.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-12T20:36:56.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-12T20:36:56.948 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-12T20:36:56.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-12T20:36:56.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-12T20:36:56.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none ' 2026-02-12T20:36:56.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-12T20:36:56.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-12T20:36:56.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-12T20:36:56.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:36:56.953 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-12T20:36:56.953 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:TEST_divergent_2 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:TEST_divergent_3 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:TEST_divergent_ec' 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:36:56.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:36:56.956 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:36:56.956 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:36:56.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:36:56.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:36:56.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:36:56.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:36:56.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:36:56.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:36:56.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:36:56.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:36:56.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:36:56.958 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:36:56.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:56.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:36:56.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:36:56.959 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:36:56.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:36:56.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:36:56.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:36:56.961 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:36:56.962 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:56.962 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:56.962 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:36:56.962 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:36:56.962 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:36:56.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-12T20:36:56.963 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:36:56.964 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:56.964 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:56.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.24351 2026-02-12T20:36:56.965 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-12T20:36:56.966 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:36:56.967 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.R8lUnRvfgj 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.R8lUnRvfgj bs=512 count=1 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr:512 bytes copied, 5.7457e-05 s, 8.9 MB/s 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.R8lUnRvfgj 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.R8lUnRvfgj 2026-02-12T20:36:56.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-12T20:36:56.969 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-12T20:36:56.969 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:36:56.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:36:56.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-12T20:36:56.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-12T20:36:56.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:36:56.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:56.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:56.992 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:56.992 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:56.992 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:56.992 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:36:56.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:36:57.018 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:36:57.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:36:57.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:36:57.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:36:57.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:36:57.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:36:57.021 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get fsid 2026-02-12T20:36:57.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:57.065 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:57.066 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:36:57.066 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:36:57.066 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get mon_host 2026-02-12T20:36:57.107 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-12T20:36:57.107 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-12T20:36:57.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:36:57.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:36:57.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:36:57.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-12T20:36:57.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:36:57.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:36:57.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:36:57.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:36:57.231 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-12T20:36:57.231 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-12T20:36:57.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:36:57.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:36:57.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:36:57.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:36:57.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:36:57.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:57.236 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:36:57.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=485f1b77-e42d-439f-9af5-e2cb8de98df6 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 485f1b77-e42d-439f-9af5-e2cb8de98df6' 2026-02-12T20:36:57.238 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 485f1b77-e42d-439f-9af5-e2cb8de98df6 2026-02-12T20:36:57.239 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:36:57.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDpOY5pZiVMDxAACrQ9morMgjBP6j28lGRwnA== 2026-02-12T20:36:57.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDpOY5pZiVMDxAACrQ9morMgjBP6j28lGRwnA=="}' 2026-02-12T20:36:57.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 485f1b77-e42d-439f-9af5-e2cb8de98df6 -i td/divergent-priors/0/new.json 2026-02-12T20:36:57.355 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:57.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-12T20:36:57.362 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDpOY5pZiVMDxAACrQ9morMgjBP6j28lGRwnA== --osd-uuid 485f1b77-e42d-439f-9af5-e2cb8de98df6 2026-02-12T20:36:57.382 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.390+0000 7f448064c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:57.383 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.392+0000 7f448064c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:57.384 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.393+0000 7f448064c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:57.385 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.393+0000 7f448064c780 -1 bdev(0x3c02c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:36:57.385 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.393+0000 7f448064c780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-12T20:36:57.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-12T20:36:57.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:36:57.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:36:57.759 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:36:57.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:36:57.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:36:57.864 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:36:57.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:36:57.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:36:57.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:36:57.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:36:57.884 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.893+0000 7f0e50239780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:57.886 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.894+0000 7f0e50239780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:57.886 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:57.895+0000 7f0e50239780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:57.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:36:57.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:36:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:36:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:36:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:36:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:36:57.967 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:36:57.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:57.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:36:58.065 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:36:58.091 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:58.099+0000 7f0e50239780 -1 Falling back to public interface 2026-02-12T20:36:58.492 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:58.501+0000 7f0e50239780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:36:59.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:36:59.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:36:59.067 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:36:59.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:36:59.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:36:59.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:36:59.168 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/285599732,v1:127.0.0.1:6801/285599732] [v2:127.0.0.1:6802/285599732,v1:127.0.0.1:6803/285599732] exists,up 485f1b77-e42d-439f-9af5-e2cb8de98df6 2026-02-12T20:36:59.172 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:36:59.172 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:36:59.172 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:36:59.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:36:59.174 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:36:59.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:36:59.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:36:59.176 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:36:59.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=53722682-c1ce-4a14-998a-7d5a2b3b5cdb 2026-02-12T20:36:59.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 53722682-c1ce-4a14-998a-7d5a2b3b5cdb' 2026-02-12T20:36:59.176 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 53722682-c1ce-4a14-998a-7d5a2b3b5cdb 2026-02-12T20:36:59.176 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:36:59.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrOY5pNYN3CxAAtPGokG++sV8jnmjHL6LTxQ== 2026-02-12T20:36:59.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrOY5pNYN3CxAAtPGokG++sV8jnmjHL6LTxQ=="}' 2026-02-12T20:36:59.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 53722682-c1ce-4a14-998a-7d5a2b3b5cdb -i td/divergent-priors/1/new.json 2026-02-12T20:36:59.290 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:36:59.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-12T20:36:59.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrOY5pNYN3CxAAtPGokG++sV8jnmjHL6LTxQ== --osd-uuid 53722682-c1ce-4a14-998a-7d5a2b3b5cdb 2026-02-12T20:36:59.316 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.325+0000 7f5cb400d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:59.318 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.326+0000 7f5cb400d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:59.318 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.327+0000 7f5cb400d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:59.319 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.328+0000 7f5cb400d780 -1 bdev(0x3b98c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:36:59.319 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.328+0000 7f5cb400d780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-12T20:36:59.639 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-12T20:36:59.639 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:36:59.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:36:59.640 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:36:59.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:36:59.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:36:59.960 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:36:59.961 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:36:59.961 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:36:59.961 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:36:59.961 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:36:59.978 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.986+0000 7f7a0b448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:59.979 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.988+0000 7f7a0b448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:36:59.980 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:36:59.989+0000 7f7a0b448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:00.114 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:00.122+0000 7f7a0b448780 -1 Falling back to public interface 2026-02-12T20:37:00.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:37:00.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:37:00.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:37:00.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:37:00.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:37:00.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:00.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:37:00.193 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:37:00.193 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:00.193 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:37:00.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:37:00.500 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:00.509+0000 7f7a0b448780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:37:01.423 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:37:01.424 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:01.424 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:37:01.424 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:37:01.424 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:01.424 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:37:01.658 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/445100078,v1:127.0.0.1:6811/445100078] [v2:127.0.0.1:6812/445100078,v1:127.0.0.1:6813/445100078] exists,up 53722682-c1ce-4a14-998a-7d5a2b3b5cdb 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:37:01.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:37:01.660 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:37:01.661 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:37:01.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b281ae7a-106c-4d8b-aff5-2a103bc6b627 2026-02-12T20:37:01.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b281ae7a-106c-4d8b-aff5-2a103bc6b627' 2026-02-12T20:37:01.662 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 b281ae7a-106c-4d8b-aff5-2a103bc6b627 2026-02-12T20:37:01.662 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:37:01.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDtOY5pZ9jFKBAAhSiEwVWlbBMMeZZ1zFDKGg== 2026-02-12T20:37:01.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDtOY5pZ9jFKBAAhSiEwVWlbBMMeZZ1zFDKGg=="}' 2026-02-12T20:37:01.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b281ae7a-106c-4d8b-aff5-2a103bc6b627 -i td/divergent-priors/2/new.json 2026-02-12T20:37:01.911 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:37:01.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-12T20:37:01.920 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtOY5pZ9jFKBAAhSiEwVWlbBMMeZZ1zFDKGg== --osd-uuid b281ae7a-106c-4d8b-aff5-2a103bc6b627 2026-02-12T20:37:01.940 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:01.949+0000 7fa2d7e38780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:01.942 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:01.950+0000 7fa2d7e38780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:01.943 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:01.951+0000 7fa2d7e38780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:01.943 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:01.952+0000 7fa2d7e38780 -1 bdev(0x32b0c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:37:01.943 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:01.952+0000 7fa2d7e38780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-12T20:37:02.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-12T20:37:02.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:37:02.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:37:02.279 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:37:02.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:37:02.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:37:02.609 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:37:02.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:37:02.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:37:02.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:37:02.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:37:02.628 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:02.637+0000 7fad9b1e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:02.630 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:02.639+0000 7fad9b1e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:02.630 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:02.639+0000 7fad9b1e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:02.813 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:02.821+0000 7fad9b1e3780 -1 Falling back to public interface 2026-02-12T20:37:02.840 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:02.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:37:03.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:37:03.135 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:03.144+0000 7fad9b1e3780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:37:04.071 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:37:04.071 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:04.072 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:37:04.072 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:37:04.072 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:04.072 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:37:04.304 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3748394738,v1:127.0.0.1:6819/3748394738] [v2:127.0.0.1:6820/3748394738,v1:127.0.0.1:6821/3748394738] exists,up b281ae7a-106c-4d8b-aff5-2a103bc6b627 2026-02-12T20:37:04.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:37:04.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:37:04.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:37:04.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-12T20:37:04.587 INFO:tasks.workunit.client.0.trial099.stderr:noout is set 2026-02-12T20:37:04.594 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-12T20:37:04.889 INFO:tasks.workunit.client.0.trial099.stderr:noin is set 2026-02-12T20:37:04.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-12T20:37:05.194 INFO:tasks.workunit.client.0.trial099.stderr:nodown is set 2026-02-12T20:37:05.202 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-12T20:37:05.202 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-12T20:37:05.459 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' already exists 2026-02-12T20:37:05.466 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:37:06.468 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-12T20:37:06.787 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 size to 3 2026-02-12T20:37:06.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-12T20:37:07.090 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 min_size to 2 2026-02-12T20:37:07.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-12T20:37:07.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:37:07.103 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:37:07.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:37:07.372 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:37:07.372 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:37:07.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:37:07.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:07.372 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:37:07.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-12T20:37:07.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-12T20:37:07.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-12T20:37:07.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:07.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:37:07.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-12T20:37:07.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-12T20:37:07.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-12T20:37:07.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:07.514 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:37:07.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-12T20:37:07.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-12T20:37:07.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-60129542147' 2026-02-12T20:37:07.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:07.581 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-12T20:37:07.582 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:07.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:37:07.583 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-12T20:37:07.583 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:07.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-12T20:37:07.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-12T20:37:07.584 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836484 2026-02-12T20:37:07.585 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:07.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:37:07.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:37:08.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:37:08.812 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:09.049 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:37:09.049 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:37:10.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:37:10.051 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:10.282 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-12T20:37:10.283 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:10.283 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-12T20:37:10.284 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:10.284 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:37:10.285 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-12T20:37:10.285 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:10.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-12T20:37:10.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-12T20:37:10.287 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 42949672964 2026-02-12T20:37:10.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:37:10.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-12T20:37:10.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:10.516 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-12T20:37:10.516 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:10.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:37:10.518 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-12T20:37:10.518 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:10.519 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-12T20:37:10.519 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-12T20:37:10.519 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542147 2026-02-12T20:37:10.519 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:37:10.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-12T20:37:10.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-12T20:37:10.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:37:10.755 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:37:10.755 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:37:10.755 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:37:10.755 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:37:10.756 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:37:10.756 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:37:10.756 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:37:10.756 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:37:10.840 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:37:10.840 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:37:10.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:37:10.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:37:10.841 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:37:10.841 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:37:11.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:37:11.070 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:37:11.070 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:37:11.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:37:11.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:11.071 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:37:11.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-12T20:37:11.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-12T20:37:11.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-12T20:37:11.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:11.140 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:37:11.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-12T20:37:11.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-12T20:37:11.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-12T20:37:11.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:11.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:37:11.276 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-12T20:37:11.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-12T20:37:11.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542150' 2026-02-12T20:37:11.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:11.277 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-12T20:37:11.278 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:11.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:37:11.279 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-12T20:37:11.279 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:11.280 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-12T20:37:11.280 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-12T20:37:11.280 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836487 2026-02-12T20:37:11.280 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:11.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-12T20:37:11.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:11.522 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-12T20:37:11.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:11.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:37:11.524 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-12T20:37:11.524 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:11.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-12T20:37:11.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-12T20:37:11.526 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 42949672966 2026-02-12T20:37:11.526 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:37:11.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-12T20:37:11.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:11.758 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-12T20:37:11.758 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:11.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:37:11.759 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-12T20:37:11.759 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:11.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-12T20:37:11.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-12T20:37:11.761 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542150 2026-02-12T20:37:11.761 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:37:11.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542150 2026-02-12T20:37:11.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:37:12.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:37:12.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:37:13.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542150 2026-02-12T20:37:13.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:37:14.230 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:37:14.230 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:37:14.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-12T20:37:14.465 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:37:14.465 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:14.465 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:14.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:15.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:37:15.010 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:15.010 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:15.011 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:15.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:37:15.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:37:15.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:37:15.343 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-12T20:37:15.343 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-12T20:37:15.563 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:37:15.570 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-12T20:37:15.570 INFO:tasks.workunit.client.0.trial099.stdout:primary and soon to be divergent is 1 2026-02-12T20:37:15.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-12T20:37:15.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-12T20:37:15.786 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:37:15.787 INFO:tasks.workunit.client.0.trial099.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-12T20:37:05.947975+0000 0'0 27:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-14T07:22:46.347003+0000 0 0 2026-02-12T20:37:15.787 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:37:15.787 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:37:15.787 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-12T20:37:15.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-12T20:37:15.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-12T20:37:15.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-12T20:37:15.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-12T20:37:15.795 INFO:tasks.workunit.client.0.trial099.stdout:writing initial objects 2026-02-12T20:37:15.796 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-12T20:37:15.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.874 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.874 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.914 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.914 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:15.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:15.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.009 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.009 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.066 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.066 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.162 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.162 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.218 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.256 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.256 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.407 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.407 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.427 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.483 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.483 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.502 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.521 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.539 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.539 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.596 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.596 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.634 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.635 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.653 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.653 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.671 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.671 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.728 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.728 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.746 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.746 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.804 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.804 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.842 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.842 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.861 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.861 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.972 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.972 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:16.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:16.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.069 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.069 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.201 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.201 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.259 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.259 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.353 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.354 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.450 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.450 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.470 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.470 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.507 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.508 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.638 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.638 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.657 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.657 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-12T20:37:17.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:17.695 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:37:17.695 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-12T20:37:17.695 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:37:17.695 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:37:17.695 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:37:17.695 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:37:17.696 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:37:17.696 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:37:17.696 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:37:17.696 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:37:17.697 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:37:17.749 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:37:17.749 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:37:17.749 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:37:17.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:37:17.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:37:17.750 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:37:17.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:37:17.974 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:37:17.974 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:37:17.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:37:17.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:17.975 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:37:18.046 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-12T20:37:18.046 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-12T20:37:18.046 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-12T20:37:18.046 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:18.046 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:37:18.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-12T20:37:18.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-12T20:37:18.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970' 2026-02-12T20:37:18.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:18.113 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:37:18.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-12T20:37:18.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-12T20:37:18.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153' 2026-02-12T20:37:18.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:18.182 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-12T20:37:18.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:18.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:37:18.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-12T20:37:18.184 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:18.185 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-12T20:37:18.185 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-12T20:37:18.185 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836490 2026-02-12T20:37:18.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:18.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-12T20:37:18.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:37:19.414 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:37:19.415 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:19.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-12T20:37:19.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:19.651 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-12T20:37:19.651 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:19.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:37:19.652 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-12T20:37:19.653 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:19.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-12T20:37:19.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-12T20:37:19.654 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 42949672970 2026-02-12T20:37:19.654 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:37:19.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-12T20:37:19.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:19.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-12T20:37:19.886 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:19.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:37:19.887 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-12T20:37:19.887 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:19.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-12T20:37:19.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-12T20:37:19.889 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542153 2026-02-12T20:37:19.889 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:37:20.117 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-12T20:37:20.117 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:37:20.118 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:20.118 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:20.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:20.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:20.657 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:37:20.658 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:20.658 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:20.659 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-12T20:37:20.983 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-12T20:37:21.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-12T20:37:21.216 INFO:tasks.workunit.client.0.trial099.stdout:blackholing osds 0 2 2026-02-12T20:37:21.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-12T20:37:21.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-12T20:37:21.436 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:37:21.436 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-12T20:37:05.947975+0000 27'100 27:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-14T07:22:46.347003+0000 0 0 2026-02-12T20:37:21.436 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:37:21.437 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:37:21.437 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:37:21.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:21.445 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-12T20:37:21.445 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:37:21.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:37:21.446 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:37:21.446 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:21.446 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:21.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:37:21.447 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-12T20:37:21.447 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-12T20:37:21.489 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:37:21.489 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:37:21.490 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:37:21.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:21.493 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-12T20:37:21.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:37:21.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:37:21.495 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:37:21.495 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:21.495 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:21.495 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:37:21.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-12T20:37:21.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-12T20:37:21.538 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:37:21.538 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:37:21.538 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:37:21.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-12T20:37:21.542 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-12T20:37:21.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-12T20:37:21.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-12T20:37:21.544 INFO:tasks.workunit.client.0.trial099.stdout:writing divergent object 2026-02-12T20:37:21.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-12T20:37:21.544 INFO:tasks.workunit.client.0.trial099.stdout:create missing divergent object 2026-02-12T20:37:21.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-12T20:37:21.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.R8lUnRvfgj 2026-02-12T20:37:21.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=test 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=existing_99 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/divergent-priors 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-12T20:37:21.547 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds test existing_99 2026-02-12T20:37:21.548 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-12T20:37:21.548 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-12T20:37:21.548 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-12T20:37:21.548 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:0 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0' '2') 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-12T20:37:21.773 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/divergent-priors/1/type 2026-02-12T20:37:21.775 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-12T20:37:21.775 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:21.776 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:37:21.777 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.24351/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-12T20:37:21.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-12T20:37:21.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-12T20:37:21.828 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-12T20:37:21.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-12T20:37:21.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:37:21.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:37:21.828 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:37:21.828 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:21.829 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:21.829 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:37:21.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-12T20:37:21.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok injectdataerr test existing_99 2026-02-12T20:37:21.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-12T20:37:21.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-12T20:37:31.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-12T20:37:31.906 INFO:tasks.workunit.client.0.trial099.stderr:rados: no process found 2026-02-12T20:37:31.906 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-12T20:37:31.907 INFO:tasks.workunit.client.0.trial099.stdout:killing all the osds 2026-02-12T20:37:31.907 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-12T20:37:32.127 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:37:32.128 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-12T20:37:21.907223+0000 27'101 27:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-14T07:22:46.347003+0000 0 0 2026-02-12T20:37:32.128 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:37:32.128 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:37:32.128 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:37:32.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-12T20:37:32.136 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:37:32.137 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:37:32.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:37:32.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:37:32.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:37:32.244 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:37:32.244 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-12T20:37:32.244 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-12T20:37:32.525 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:37:32.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-12T20:37:32.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-12T20:37:32.811 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:37:32.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-12T20:37:32.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-12T20:37:33.095 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:37:33.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:33.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-12T20:37:33.382 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already out. 2026-02-12T20:37:33.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:33.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-12T20:37:33.674 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already out. 2026-02-12T20:37:33.682 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-12T20:37:33.683 INFO:tasks.workunit.client.0.trial099.stdout:bringing up non_divergent 0 2 2026-02-12T20:37:33.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-12T20:37:33.904 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:37:33.904 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-12T20:37:21.907223+0000 27'101 27:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-14T07:22:46.347003+0000 0 0 2026-02-12T20:37:33.905 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:37:33.905 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:37:33.905 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:37:33.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:37:33.916 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:37:33.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:37:33.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:37:33.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:37:33.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:37:33.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:37:33.918 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:37:33.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:37:33.919 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-12T20:37:33.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:37:33.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:37:33.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:37:33.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:37:33.933 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:33.942+0000 7f61a0840780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:33.935 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:33.944+0000 7f61a0840780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:33.936 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:33.945+0000 7f61a0840780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:34.057 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:34.066+0000 7f61a0840780 -1 Falling back to public interface 2026-02-12T20:37:34.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:37:34.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:37:34.146 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:37:34.146 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:37:34.146 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:37:34.146 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:34.146 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:37:34.146 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:37:34.147 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:34.147 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:37:34.373 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:37:34.428 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:34.437+0000 7f61a0840780 -1 osd.0 27 log_to_monitors true 2026-02-12T20:37:35.374 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:37:35.375 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:35.375 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:37:35.375 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:37:35.376 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:35.376 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:37:35.615 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up out weight 0 up_from 34 up_thru 0 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/1138379026,v1:127.0.0.1:6801/1138379026] [v2:127.0.0.1:6802/1138379026,v1:127.0.0.1:6803/1138379026] exists,up 485f1b77-e42d-439f-9af5-e2cb8de98df6 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:37:35.619 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:37:35.620 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:37:35.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:37:35.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:37:35.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:37:35.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:37:35.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:37:35.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:37:35.622 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:37:35.623 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-12T20:37:35.623 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:37:35.623 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:37:35.623 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:37:35.624 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:37:35.624 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:37:35.636 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:35.644+0000 7fe02c039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:35.637 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:35.646+0000 7fe02c039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:35.638 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:35.647+0000 7fe02c039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:37:35.835 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:35.844+0000 7fe02c039780 -1 Falling back to public interface 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:35.852 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:37:35.853 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:37:35.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:35.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:37:36.083 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:37:36.127 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:37:36.136+0000 7fe02c039780 -1 osd.2 27 log_to_monitors true 2026-02-12T20:37:37.084 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:37:37.084 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:37:37.084 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:37:37.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:37:37.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:37:37.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:37:37.319 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/3588626874,v1:127.0.0.1:6811/3588626874] [v2:127.0.0.1:6812/3588626874,v1:127.0.0.1:6813/3588626874] exists,up b281ae7a-106c-4d8b-aff5-2a103bc6b627 2026-02-12T20:37:37.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:37:37.321 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:37:37.321 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:37:37.321 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:37.321 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-12T20:37:37.599 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already in. 2026-02-12T20:37:37.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-12T20:37:37.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-12T20:37:37.885 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already in. 2026-02-12T20:37:37.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:37:37.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-12T20:37:37.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:37:37.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:37:37.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:37:37.894 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:37:37.895 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:37:37.895 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:37:37.895 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:37:37.895 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:37:37.895 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:37:37.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:37:37.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:37:37.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:37:37.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:37:37.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:37:37.946 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:37:38.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:37:38.177 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:37:38.177 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:37:38.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:37:38.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:38.178 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:37:38.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-12T20:37:38.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-12T20:37:38.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067' 2026-02-12T20:37:38.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:38.246 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:37:38.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:37:38.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:37:38.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:37:38.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:37:38.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:37:38.297 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:37:38.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-12T20:37:38.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-12T20:37:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067 2-154618822659' 2026-02-12T20:37:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:38.366 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888067 2026-02-12T20:37:38.366 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:37:38.367 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888067 2026-02-12T20:37:38.367 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:38.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-12T20:37:38.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888067' 2026-02-12T20:37:38.368 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 146028888067 2026-02-12T20:37:38.369 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:38.610 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 146028888067 2026-02-12T20:37:38.610 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:37:39.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:37:39.612 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:37:39.846 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-12T20:37:39.846 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:37:39.847 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-154618822659 2026-02-12T20:37:39.847 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:37:39.848 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:37:39.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822659 2026-02-12T20:37:39.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:37:39.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-12T20:37:39.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-12T20:37:39.850 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 154618822659 2026-02-12T20:37:39.850 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:37:40.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-12T20:37:40.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:37:40.090 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:40.090 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:40.421 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:37:40.421 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:40.422 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:40.422 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:40.422 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:40.422 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:40.423 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:40.423 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:40.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:40.660 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:40.660 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:40.660 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:40.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:40.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:37:40.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:37:40.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:37:40.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:40.994 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:37:41.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:41.094 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:41.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:41.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:41.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:41.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:41.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:41.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:41.322 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:41.322 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:41.323 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:41.323 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:41.647 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:41.962 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:41.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:41.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:37:41.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:41.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:37:42.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:42.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:42.164 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:42.165 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:42.165 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:42.165 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:42.165 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:42.165 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:42.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:42.391 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:42.391 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:42.392 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:42.717 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:42.717 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:42.718 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:43.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:43.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:43.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:37:43.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:43.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:37:43.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:43.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:43.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:43.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:43.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:43.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:43.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:43.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:43.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:43.677 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:43.677 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:43.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:44.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:44.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:44.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:44.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:44.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:44.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:44.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:44.002 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:44.002 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:44.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:44.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:44.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:37:44.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:44.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:37:45.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:45.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:45.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:45.122 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:45.122 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:45.122 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:45.122 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:45.122 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:45.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:45.351 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:45.351 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:45.352 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:45.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:45.670 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:37:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:37:47.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:47.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:47.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:47.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:47.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:47.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:47.592 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:47.592 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:47.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:47.824 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:47.824 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:47.824 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:48.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:48.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:48.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:48.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:48.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:48.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:48.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:48.141 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:48.141 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:48.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:48.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:48.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:37:48.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:48.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:37:51.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:51.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:51.677 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:51.677 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:51.677 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:51.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:51.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:51.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:51.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:51.904 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:51.904 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:51.905 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:52.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:52.242 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:52.242 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:52.557 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:52.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:52.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:37:52.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:52.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:37:58.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:37:58.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:37:58.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:37:58.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:37:58.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:37:58.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:37:58.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:37:58.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:37:59.184 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:37:59.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:37:59.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:37:59.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:37:59.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:37:59.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:37:59.506 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:37:59.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:37:59.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:37:59.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:37:59.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:37:59.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:38:07.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:38:07.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:38:07.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:38:07.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:38:07.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:38:07.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:38:07.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:38:07.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:38:07.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:38:07.359 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:38:07.359 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:38:07.359 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:38:07.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:38:07.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:38:07.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:38:07.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:38:07.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:38:07.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:38:07.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:38:08.302 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:38:08.302 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "4485d69b-16a3-40ab-a9f3-74bb89524af5", 2026-02-12T20:38:08.302 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:38:08.311042+0000", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:38:08.303 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:38:08.304 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.305 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:38:08.306 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:36:56.994098Z", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:36:56.994098Z", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:38:08.307 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:38:08.308 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.309 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:36:56:994093+0000", 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.310 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 40, 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:36:57.030404+0000", 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:37:37.931608+0000", 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:37:36.277134+0000", 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:37:37.829359+0000", 2026-02-12T20:38:08.311 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 9, 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:38:08.312 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:37:05.380347+0000", 2026-02-12T20:38:08.313 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 1, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool", 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 0, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "off", 2026-02-12T20:38:08.314 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 1, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 1, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 1, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 1, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.315 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "27", 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "0", 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "selfmanaged", 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 0, 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 0, 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [], 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:38:08.316 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "", 2026-02-12T20:38:08.317 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:38:08.318 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {}, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "read_balance": { 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "score_type": "Fair distribution", 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "score_acting": 2.9900000095367432, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "score_stable": 2.9900000095367432, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_score": 0.67000001668930054, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_acting": 2, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_stable": 2, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity_weighted": 1, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity": 1, 2026-02-12T20:38:08.319 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity_weighted": 1 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "485f1b77-e42d-439f-9af5-e2cb8de98df6", 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 5, 2026-02-12T20:38:08.320 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 27, 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 34, 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 39, 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 28, 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.321 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.322 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:38:08.323 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.324 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 1138379026 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/1138379026", 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/1138379026", 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1138379026", 2026-02-12T20:38:08.325 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1138379026", 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "53722682-c1ce-4a14-998a-7d5a2b3b5cdb", 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:38:08.326 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 10, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 21, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 29, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.327 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.328 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:38:08.329 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.330 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 445100078 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/445100078", 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/445100078", 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/445100078", 2026-02-12T20:38:08.331 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/445100078", 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "b281ae7a-106c-4d8b-aff5-2a103bc6b627", 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 14, 2026-02-12T20:38:08.332 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 27, 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 36, 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 30, 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.333 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.334 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.335 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.336 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3588626874 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/3588626874", 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/3588626874", 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3588626874", 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3588626874", 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:38:08.337 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:37:32.470307+0000", 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:38:08.338 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:36:59.467547+0000", 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:37:32.756139+0000", 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.339 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:37:33.039777+0000", 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:37:04.194495+0000", 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:38:08.340 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:38:08.341 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/1138379026,v1:127.0.0.1:6803/1138379026]", 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:38:08.342 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:38:08.343 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:36:57.705650Z", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:38:08.344 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/1138379026,v1:127.0.0.1:6801/1138379026]", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1138379026,v1:127.0.0.1:6807/1138379026]", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1138379026,v1:127.0.0.1:6805/1138379026]", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:38:08.345 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/445100078,v1:127.0.0.1:6813/445100078]", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:38:08.346 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:36:59.602083Z", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:38:08.347 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/445100078,v1:127.0.0.1:6811/445100078]", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/445100078,v1:127.0.0.1:6817/445100078]", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/445100078,v1:127.0.0.1:6815/445100078]", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:38:08.348 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/3588626874,v1:127.0.0.1:6813/3588626874]", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:38:08.349 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:38:08.350 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:37:02.236106Z", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/3588626874,v1:127.0.0.1:6811/3588626874]", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3588626874,v1:127.0.0.1:6817/3588626874]", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3588626874,v1:127.0.0.1:6815/3588626874]", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:38:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 0, 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [] 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.352 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 34 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 36 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 40, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:38:08.353 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:38:08.354 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:38:08.355 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:38:08.356 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:38:08.357 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.358 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:38:08.359 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:38:08.361 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 0, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stderr:report 3023828790 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:38:08.362 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:36:57:030229+0000", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:38:08.363 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 1, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51200, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:38:08.364 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 100, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 100, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:38:08.365 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 16, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 16, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "up": 2, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 2, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:38:08.366 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83860, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2080, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 26, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81701, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488940, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036674560, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2129920, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 420674, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 26704, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83662768 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 1, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.367 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83860, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2080, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 26, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81701, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488940, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036674560, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2129920, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 420674, 2026-02-12T20:38:08.368 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 26704, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83662768 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 1, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:38:08.369 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51200, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 100, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 100, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:38:08.370 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1228800, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 153600, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 16, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 16, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "up": 2, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 2, 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:38:08.371 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 146028888073 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 42949672973 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 154618822665 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "num": 1 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:38:08.372 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 1, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 3, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:38:03.252560+0000", 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "services": { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "osd": { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "daemons": { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "summary": "", 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "0": { 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:38:08.373 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "2": { 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 36, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 222, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 308, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:38:08.374 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:38:08.375 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:38:08.375 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-12T20:38:08.375 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-12T20:38:08.375 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-12T20:38:08.375 INFO:tasks.workunit.client.0.trial099.stdout:writing non-divergent object existing_4 2026-02-12T20:38:08.375 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:08.529 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:08.529 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 27'100 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:08.529 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:08.529 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:08.530 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:08.537 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-12T20:38:08.537 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-12T20:38:08.538 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:38:08.538 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:38:08.538 INFO:tasks.workunit.client.0.trial099.stderr:1000 bytes (1.0 kB) copied, 1.5328e-05 s, 65.2 MB/s 2026-02-12T20:38:08.558 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery 2026-02-12T20:38:08.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-12T20:38:08.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:08.775 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:08.775 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 27'100 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:08.775 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:08.775 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:08.776 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:08.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:08.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:38:08.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-12T20:38:08.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok set_recovery_delay 100000 2026-02-12T20:38:08.828 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:38:08.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-12T20:38:08.833 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-12T20:38:08.833 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:38:08.833 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:38:08.833 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:38:08.833 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:08.833 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:08.834 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:38:08.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-12T20:38:08.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok set_recovery_delay 100000 2026-02-12T20:38:08.876 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:38:08.880 INFO:tasks.workunit.client.0.trial099.stdout:revive divergent 1 2026-02-12T20:38:08.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-12T20:38:08.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:09.097 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:09.097 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 27'100 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:09.097 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:09.097 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:09.098 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:09.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-12T20:38:09.418 INFO:tasks.workunit.client.0.trial099.stderr:noup is set 2026-02-12T20:38:09.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-12T20:38:09.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:38:09.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:38:09.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:09.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:38:09.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:38:09.433 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:38:09.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:38:09.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:38:09.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:38:09.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:38:09.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:38:09.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:38:09.448 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:09.457+0000 7f90749d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:09.449 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:09.458+0000 7f90749d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:09.450 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:09.459+0000 7f90749d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:09.595 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:09.604+0000 7f90749d8780 -1 Falling back to public interface 2026-02-12T20:38:09.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-12T20:38:09.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-12T20:38:09.911 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:09.919+0000 7f90749d8780 -1 osd.1 27 log_to_monitors true 2026-02-12T20:38:14.662 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery divergent 2026-02-12T20:38:14.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-12T20:38:14.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:14.883 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:14.883 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 40'101 42:137 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:14.883 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:14.884 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:14.884 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:14.892 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-12T20:38:14.892 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:38:14.892 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:38:14.892 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:38:14.892 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:14.892 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:14.893 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:38:14.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-12T20:38:14.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok set_recovery_delay 100000 2026-02-12T20:38:14.938 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:38:14.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-12T20:38:15.255 INFO:tasks.workunit.client.0.trial099.stderr:noup is unset 2026-02-12T20:38:15.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:15.266 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:15.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:15.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:38:15.502 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 34 up_thru 39 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/1138379026,v1:127.0.0.1:6801/1138379026] [v2:127.0.0.1:6802/1138379026,v1:127.0.0.1:6803/1138379026] exists,up 485f1b77-e42d-439f-9af5-e2cb8de98df6 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:15.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:15.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:15.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:15.505 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:15.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:15.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:38:15.732 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 29 last_clean_interval [10,27) [v2:127.0.0.1:6818/1970225897,v1:127.0.0.1:6819/1970225897] [v2:127.0.0.1:6820/1970225897,v1:127.0.0.1:6821/1970225897] exists,up 53722682-c1ce-4a14-998a-7d5a2b3b5cdb 2026-02-12T20:38:15.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:15.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:15.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:15.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-12T20:38:15.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:15.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:38:15.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:15.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:15.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:15.734 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:15.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:15.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:15.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:38:15.969 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/3588626874,v1:127.0.0.1:6811/3588626874] [v2:127.0.0.1:6812/3588626874,v1:127.0.0.1:6813/3588626874] exists,up b281ae7a-106c-4d8b-aff5-2a103bc6b627 2026-02-12T20:38:15.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:15.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:15.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:15.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:16.188 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:16.188 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:16.188 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:16.188 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:16.188 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:16.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-12T20:38:16.196 INFO:tasks.workunit.client.0.trial099.stdout:wait for peering 2026-02-12T20:38:16.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:16.412 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:16.412 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:16.412 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:16.413 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:16.413 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:16.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.R8lUnRvfgj 2026-02-12T20:38:16.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-12T20:38:16.440 INFO:tasks.workunit.client.0.trial099.stdout:killing divergent 1 2026-02-12T20:38:16.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:16.655 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:16.655 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:16.655 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:16.655 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:16.656 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:16.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-12T20:38:16.663 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:38:16.663 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:38:16.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:38:16.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:38:16.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:38:16.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:38:16.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-12T20:38:16.770 INFO:tasks.workunit.client.0.trial099.stdout:reviving divergent 1 2026-02-12T20:38:16.770 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:16.990 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:16.990 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:37:37.933870+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-13T23:57:18.377078+0000 0 0 2026-02-12T20:38:16.990 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:16.990 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:16.990 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:17.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-12T20:38:17.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:38:17.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:38:17.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:38:17.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:38:17.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:38:17.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:38:17.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:38:17.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:38:17.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:38:17.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:38:17.005 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:38:17.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:38:17.006 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:38:17.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:38:17.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:38:17.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:38:17.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:38:17.019 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:17.028+0000 7fd2daa45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:17.021 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:17.029+0000 7fd2daa45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:17.021 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:17.030+0000 7fd2daa45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:17.160 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:17.169+0000 7fd2daa45780 -1 Falling back to public interface 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:17.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:17.229 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:17.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:17.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:38:17.462 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 29 last_clean_interval [10,27) [v2:127.0.0.1:6818/1970225897,v1:127.0.0.1:6819/1970225897] [v2:127.0.0.1:6820/1970225897,v1:127.0.0.1:6821/1970225897] exists,up 53722682-c1ce-4a14-998a-7d5a2b3b5cdb 2026-02-12T20:38:17.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:17.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:17.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:17.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-12T20:38:17.503 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:17.512+0000 7fd2daa45780 -1 osd.1 47 log_to_monitors true 2026-02-12T20:38:37.463 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-12T20:38:37.464 INFO:tasks.workunit.client.0.trial099.stdout:allowing recovery 2026-02-12T20:38:37.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:37.683 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:37.684 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-12T20:38:17.926674+0000 47'102 51:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-14T04:40:51.841071+0000 0 0 2026-02-12T20:38:37.684 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:37.684 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:37.684 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:37.691 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-12T20:38:37.691 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-12T20:38:37.753 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:38:37.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-12T20:38:37.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-12T20:38:37.821 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:38:37.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-12T20:38:37.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-12T20:38:37.888 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:38:37.892 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-12T20:38:37.892 INFO:tasks.workunit.client.0.trial099.stdout:reading divergent objects 2026-02-12T20:38:37.892 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-12T20:38:38.117 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:38:38.118 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-12T20:38:17.926674+0000 47'102 51:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:37:05.406344+0000 0'0 2026-02-12T20:37:05.406344+0000 0 0 periodic scrub scheduled @ 2026-02-14T04:40:51.841071+0000 0 0 2026-02-12T20:38:38.118 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:38:38.118 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:38:38.118 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:38:38.126 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-12T20:38:38.127 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-12T20:38:38.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:38:38.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-12T20:38:38.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:38:38.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-12T20:38:38.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:38:38.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-12T20:38:38.186 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:38:38.186 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-12T20:38:38.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-12T20:38:38.207 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-12T20:38:38.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:38:38.211 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-12T20:37:21.571723+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 20 _merge_object_divergent_entries: keeping 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-12T20:37:21.571723+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 27'100 first_divergent_update: 27'101 last_divergent_update: 27'101 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 27'101 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-12T20:37:21.571723+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-12T20:38:38.212 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:38:15.371+0000 7f9056525640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-12T20:38:38.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-12T20:38:38.213 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:38:38.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-12T20:38:38.216 INFO:tasks.workunit.client.0.trial099.stdout:success 2026-02-12T20:38:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.R8lUnRvfgj 2026-02-12T20:38:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-12T20:38:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-12T20:38:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-12T20:38:38.455 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' does not exist 2026-02-12T20:38:38.463 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-12T20:38:38.464 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:38:38.464 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:38:38.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:38:38.465 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:38:38.465 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:38:43.778 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:38:43.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:38:43.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:38:43.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:38:43.784 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:38:43.785 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:38:43.785 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:38:43.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:38:43.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:38:43.787 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:38:43.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:38:43.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:38:43.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:38:43.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:38:43.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:38:43.790 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:38:43.790 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:38:43.805 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:38:43.805 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:43.806 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:43.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:38:43.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:38:43.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:38:43.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:38:43.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:38:43.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:38:43.809 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:38:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:38:43.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:38:43.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:38:43.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:38:43.811 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:38:43.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:38:43.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:38:43.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:38:43.812 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:38:43.813 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:38:43.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:38:43.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:38:43.815 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:38:43.815 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:43.815 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:43.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:38:43.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:38:43.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:38:43.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-12T20:38:43.817 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:38:43.817 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:43.818 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:43.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.24351 2026-02-12T20:38:43.819 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-12T20:38:43.820 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:38:43.821 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.b1bzb2mlRC 2026-02-12T20:38:43.821 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.b1bzb2mlRC bs=512 count=1 2026-02-12T20:38:43.822 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:38:43.822 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:38:43.822 INFO:tasks.workunit.client.0.trial099.stderr:512 bytes copied, 5.1736e-05 s, 9.9 MB/s 2026-02-12T20:38:43.822 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.b1bzb2mlRC 2026-02-12T20:38:43.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.b1bzb2mlRC 2026-02-12T20:38:43.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-12T20:38:43.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-12T20:38:43.823 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:38:43.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.J03NS5kTsK 2026-02-12T20:38:43.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.J03NS5kTsK bs=1000 count=1 2026-02-12T20:38:43.824 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:38:43.824 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:38:43.824 INFO:tasks.workunit.client.0.trial099.stderr:1000 bytes (1.0 kB) copied, 4.7057e-05 s, 21.3 MB/s 2026-02-12T20:38:43.825 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.J03NS5kTsK 2026-02-12T20:38:43.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.J03NS5kTsK 2026-02-12T20:38:43.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-12T20:38:43.825 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-12T20:38:43.825 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-12T20:38:43.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-12T20:38:43.847 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:43.848 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:38:43.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:38:43.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:38:43.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:38:43.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:38:43.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:38:43.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:43.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:38:43.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:38:43.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get fsid 2026-02-12T20:38:43.922 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:38:43.922 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:38:43.922 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:38:43.922 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:38:43.923 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:38:43.923 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:38:43.923 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:38:43.923 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:38:43.924 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:38:43.924 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:43.924 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:43.924 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:38:43.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:38:43.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get mon_host 2026-02-12T20:38:43.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-12T20:38:43.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-12T20:38:43.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:38:43.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:38:43.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:38:43.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-12T20:38:43.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:44.069 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:44.070 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:38:44.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:38:44.090 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:38:44.091 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:38:44.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:38:44.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0c02772d-60e9-4bf9-975b-08ad2ae9ad23 2026-02-12T20:38:44.094 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 0c02772d-60e9-4bf9-975b-08ad2ae9ad23 2026-02-12T20:38:44.094 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0c02772d-60e9-4bf9-975b-08ad2ae9ad23' 2026-02-12T20:38:44.094 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:38:44.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBUOo5peZqyBhAAv1yjWZJOoUfVvRTx7la5yg== 2026-02-12T20:38:44.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBUOo5peZqyBhAAv1yjWZJOoUfVvRTx7la5yg=="}' 2026-02-12T20:38:44.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0c02772d-60e9-4bf9-975b-08ad2ae9ad23 -i td/divergent-priors/0/new.json 2026-02-12T20:38:44.208 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:44.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-12T20:38:44.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBUOo5peZqyBhAAv1yjWZJOoUfVvRTx7la5yg== --osd-uuid 0c02772d-60e9-4bf9-975b-08ad2ae9ad23 2026-02-12T20:38:44.237 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.246+0000 7feb11a47780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:44.238 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.247+0000 7feb11a47780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:44.239 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.248+0000 7feb11a47780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:44.240 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.248+0000 7feb11a47780 -1 bdev(0x3456c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:38:44.240 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.248+0000 7feb11a47780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-12T20:38:44.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-12T20:38:44.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:38:44.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:38:44.645 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:38:44.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:38:44.753 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:38:44.753 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:38:44.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:38:44.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:38:44.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:38:44.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:38:44.773 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.782+0000 7ff70c829780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:44.774 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.783+0000 7ff70c829780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:44.775 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.784+0000 7ff70c829780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:44.855 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:38:44.855 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:44.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:38:44.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:44.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:44.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:44.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:44.856 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:44.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:44.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:38:44.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:38:44.991 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:44.999+0000 7ff70c829780 -1 Falling back to public interface 2026-02-12T20:38:45.354 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:45.362+0000 7ff70c829780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:38:45.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:38:45.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:45.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:38:45.958 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:38:45.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:45.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:38:46.056 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1514493018,v1:127.0.0.1:6801/1514493018] [v2:127.0.0.1:6802/1514493018,v1:127.0.0.1:6803/1514493018] exists,up 0c02772d-60e9-4bf9-975b-08ad2ae9ad23 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:38:46.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:38:46.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:38:46.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:38:46.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1fb6d861-89db-4a55-80cb-43e71de5308f' 2026-02-12T20:38:46.065 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:38:46.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:38:46.073 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBWOo5p+m3pBBAAO6GlFmsBNaXJAXh/XT7Bfg== 2026-02-12T20:38:46.073 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBWOo5p+m3pBBAAO6GlFmsBNaXJAXh/XT7Bfg=="}' 2026-02-12T20:38:46.073 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1fb6d861-89db-4a55-80cb-43e71de5308f -i td/divergent-priors/1/new.json 2026-02-12T20:38:46.176 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:38:46.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-12T20:38:46.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBWOo5p+m3pBBAAO6GlFmsBNaXJAXh/XT7Bfg== --osd-uuid 1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:38:46.203 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.212+0000 7fe6e9025780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:46.204 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.213+0000 7fe6e9025780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:46.205 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.214+0000 7fe6e9025780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:46.206 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.214+0000 7fe6e9025780 -1 bdev(0x2a58c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:38:46.206 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.214+0000 7fe6e9025780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-12T20:38:46.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-12T20:38:46.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:38:46.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:38:46.542 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:38:46.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:38:46.861 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:38:46.862 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:38:46.863 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:38:46.863 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:38:46.863 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:38:46.863 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:38:46.881 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.889+0000 7f71c8e17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:46.882 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.890+0000 7f71c8e17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:46.882 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:46.891+0000 7f71c8e17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:47.012 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:47.020+0000 7f71c8e17780 -1 Falling back to public interface 2026-02-12T20:38:47.092 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:47.093 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:47.094 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:47.094 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:38:47.322 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:38:47.349 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:47.357+0000 7f71c8e17780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:38:48.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:38:48.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:48.323 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:38:48.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:38:48.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:48.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:38:48.555 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4211426563,v1:127.0.0.1:6811/4211426563] [v2:127.0.0.1:6812/4211426563,v1:127.0.0.1:6813/4211426563] exists,up 1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:38:48.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:48.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:38:48.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:38:48.561 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:38:48.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=018017e1-54f9-4ed4-adff-ca1fdeb1a573 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 018017e1-54f9-4ed4-adff-ca1fdeb1a573' 2026-02-12T20:38:48.563 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 018017e1-54f9-4ed4-adff-ca1fdeb1a573 2026-02-12T20:38:48.564 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:38:48.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBYOo5pBBiPIhAAp5O7GWfP5NwYlLTvFIoHBA== 2026-02-12T20:38:48.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBYOo5pBBiPIhAAp5O7GWfP5NwYlLTvFIoHBA=="}' 2026-02-12T20:38:48.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 018017e1-54f9-4ed4-adff-ca1fdeb1a573 -i td/divergent-priors/2/new.json 2026-02-12T20:38:48.810 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:38:48.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-12T20:38:48.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBYOo5pBBiPIhAAp5O7GWfP5NwYlLTvFIoHBA== --osd-uuid 018017e1-54f9-4ed4-adff-ca1fdeb1a573 2026-02-12T20:38:48.838 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:48.847+0000 7f6a7c22f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:48.840 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:48.848+0000 7f6a7c22f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:48.841 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:48.849+0000 7f6a7c22f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:48.841 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:48.850+0000 7f6a7c22f780 -1 bdev(0x42d4c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:38:48.841 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:48.850+0000 7f6a7c22f780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-12T20:38:49.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-12T20:38:49.162 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:38:49.162 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:38:49.162 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:38:49.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:38:49.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:38:49.487 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:38:49.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:38:49.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:38:49.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:38:49.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:38:49.505 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:49.514+0000 7fc7c7bc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:49.507 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:49.516+0000 7fc7c7bc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:49.508 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:49.516+0000 7fc7c7bc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:38:49.691 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:49.700+0000 7fc7c7bc6780 -1 Falling back to public interface 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:49.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:38:49.940 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:38:50.082 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:38:50.091+0000 7fc7c7bc6780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:38:50.941 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:38:50.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:38:50.942 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:38:50.943 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:38:50.943 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:38:50.943 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:38:51.170 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4231319981,v1:127.0.0.1:6819/4231319981] [v2:127.0.0.1:6820/4231319981,v1:127.0.0.1:6821/4231319981] exists,up 018017e1-54f9-4ed4-adff-ca1fdeb1a573 2026-02-12T20:38:51.170 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:38:51.171 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:38:51.171 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:38:51.171 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-12T20:38:51.455 INFO:tasks.workunit.client.0.trial099.stderr:noout is set 2026-02-12T20:38:51.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-12T20:38:51.758 INFO:tasks.workunit.client.0.trial099.stderr:noin is set 2026-02-12T20:38:51.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-12T20:38:52.063 INFO:tasks.workunit.client.0.trial099.stderr:nodown is set 2026-02-12T20:38:52.071 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-12T20:38:52.071 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-12T20:38:52.327 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' already exists 2026-02-12T20:38:52.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:38:53.336 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-12T20:38:53.651 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 size to 3 2026-02-12T20:38:53.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-12T20:38:53.957 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 min_size to 2 2026-02-12T20:38:53.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-12T20:38:53.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:38:53.968 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:38:54.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:38:54.206 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:38:54.206 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:38:54.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:38:54.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:38:54.206 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:38:54.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-12T20:38:54.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-12T20:38:54.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-12T20:38:54.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:38:54.275 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:38:54.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-12T20:38:54.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-12T20:38:54.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-12T20:38:54.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:38:54.344 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:38:54.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-12T20:38:54.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-12T20:38:54.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-64424509443' 2026-02-12T20:38:54.414 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:38:54.414 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-12T20:38:54.414 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:38:54.415 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:38:54.415 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-12T20:38:54.415 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:38:54.416 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-12T20:38:54.416 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-12T20:38:54.416 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836484 2026-02-12T20:38:54.417 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:38:54.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:38:54.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:38:55.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:38:55.647 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:38:55.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:38:55.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:38:56.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:38:56.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:38:57.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-12T20:38:57.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:38:57.114 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-12T20:38:57.114 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:38:57.114 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:38:57.114 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-12T20:38:57.115 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:38:57.115 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-12T20:38:57.116 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-12T20:38:57.116 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 42949672964 2026-02-12T20:38:57.116 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:38:57.341 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-12T20:38:57.341 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:38:57.342 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-12T20:38:57.342 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:38:57.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:38:57.343 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-12T20:38:57.343 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:38:57.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-12T20:38:57.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-12T20:38:57.345 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 64424509443 2026-02-12T20:38:57.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:38:57.574 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:38:57.575 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:38:57.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:38:57.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:38:57.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:38:57.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:38:57.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:38:57.659 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:38:57.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:38:57.888 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:38:57.888 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:38:57.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:38:57.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:38:57.888 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:38:57.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-12T20:38:57.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-12T20:38:57.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-12T20:38:57.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:38:57.959 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:38:58.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-12T20:38:58.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-12T20:38:58.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-12T20:38:58.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:38:58.028 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:38:58.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-12T20:38:58.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-12T20:38:58.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-64424509446' 2026-02-12T20:38:58.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:38:58.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-12T20:38:58.095 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:38:58.096 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:38:58.097 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-12T20:38:58.097 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:38:58.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-12T20:38:58.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-12T20:38:58.098 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836487 2026-02-12T20:38:58.098 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:38:58.325 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-12T20:38:58.325 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:38:58.325 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-12T20:38:58.325 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:38:58.326 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:38:58.327 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-12T20:38:58.327 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:38:58.328 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-12T20:38:58.328 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-12T20:38:58.328 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 42949672966 2026-02-12T20:38:58.328 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:38:58.556 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-12T20:38:58.556 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:38:58.557 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509446 2026-02-12T20:38:58.557 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:38:58.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:38:58.559 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-12T20:38:58.559 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:38:58.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509446 2026-02-12T20:38:58.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-12T20:38:58.560 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 64424509446 2026-02-12T20:38:58.560 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:38:58.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509444 -lt 64424509446 2026-02-12T20:38:58.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:38:59.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:38:59.798 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:39:00.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509444 -lt 64424509446 2026-02-12T20:39:00.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:39:01.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:39:01.028 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:39:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-12T20:39:01.272 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:39:01.273 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:01.273 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:01.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:01.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:01.823 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:39:01.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:01.824 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:01.824 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:02.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:39:02.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:39:02.144 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:39:02.144 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-12T20:39:02.144 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-12T20:39:02.363 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:39:02.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-12T20:39:02.372 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-12T20:39:02.373 INFO:tasks.workunit.client.0.trial099.stdout:primary and soon to be divergent is 1 2026-02-12T20:39:02.373 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:39:02.592 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:39:02.592 INFO:tasks.workunit.client.0.trial099.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-12T20:38:52.462483+0000 0'0 28:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:19:54.484987+0000 0 0 2026-02-12T20:39:02.593 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:39:02.593 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:39:02.593 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:39:02.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-12T20:39:02.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-12T20:39:02.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-12T20:39:02.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-12T20:39:02.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-12T20:39:02.600 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-12T20:39:02.601 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-12T20:39:02.601 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-12T20:39:02.601 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-12T20:39:02.601 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-12T20:39:02.601 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-12T20:39:02.601 INFO:tasks.workunit.client.0.trial099.stdout:writing initial objects 2026-02-12T20:39:02.602 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-12T20:39:02.602 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.602 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.717 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.719 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.753 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.772 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.772 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.845 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.845 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.901 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.901 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.920 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.920 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.938 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.938 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:02.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:02.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.065 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.066 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.084 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.084 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.121 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.121 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.138 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.139 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.264 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.264 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.282 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.282 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.301 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.301 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.321 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.321 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.359 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.359 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.378 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.378 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.415 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.415 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.473 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.473 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.550 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.550 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.568 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.568 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.740 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.740 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.892 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.892 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.910 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.910 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:03.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:03.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.043 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.044 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.100 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.100 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.138 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.138 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.269 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.270 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.307 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.325 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.326 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.459 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-12T20:39:04.459 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.b1bzb2mlRC 2026-02-12T20:39:04.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:39:04.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-12T20:39:04.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:39:04.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:39:04.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:39:04.478 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:39:04.479 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:39:04.479 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:39:04.479 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:39:04.479 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:39:04.479 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:39:04.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:39:04.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:39:04.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:39:04.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:39:04.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:39:04.532 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:39:04.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:39:04.767 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:39:04.767 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:39:04.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:39:04.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:04.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:39:04.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-12T20:39:04.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-12T20:39:04.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-12T20:39:04.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:04.835 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:39:04.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-12T20:39:04.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-12T20:39:04.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970' 2026-02-12T20:39:04.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:04.905 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:39:04.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509449 2026-02-12T20:39:04.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509449 2026-02-12T20:39:04.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-64424509449' 2026-02-12T20:39:04.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:04.975 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-12T20:39:04.975 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:04.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:39:04.976 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-12T20:39:04.976 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:04.977 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-12T20:39:04.977 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-12T20:39:04.977 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836490 2026-02-12T20:39:04.977 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:39:05.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-12T20:39:05.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:39:06.205 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:39:06.206 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:39:06.436 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-12T20:39:06.436 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:06.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-12T20:39:06.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:06.437 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:39:06.438 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-12T20:39:06.438 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:06.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-12T20:39:06.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-12T20:39:06.439 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 42949672970 2026-02-12T20:39:06.439 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:39:06.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-12T20:39:06.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:06.679 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509449 2026-02-12T20:39:06.679 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:39:06.680 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509449 2026-02-12T20:39:06.681 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:06.682 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509449 2026-02-12T20:39:06.682 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2026-02-12T20:39:06.682 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 64424509449 2026-02-12T20:39:06.682 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:39:06.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509449 -lt 64424509449 2026-02-12T20:39:06.916 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:39:06.916 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:06.917 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:07.234 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:07.460 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:39:07.460 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:07.461 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:07.461 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:07.792 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-12T20:39:07.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-12T20:39:08.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-12T20:39:08.027 INFO:tasks.workunit.client.0.trial099.stdout:blackholing osds 0 2 2026-02-12T20:39:08.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-12T20:39:08.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:39:08.248 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:39:08.248 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-12T20:38:52.462483+0000 28'100 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:19:54.484987+0000 0 0 2026-02-12T20:39:08.248 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:39:08.248 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:39:08.249 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:39:08.256 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:39:08.257 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:39:08.258 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-12T20:39:08.258 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-12T20:39:08.302 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:39:08.302 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:39:08.302 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:39:08.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:39:08.307 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:39:08.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-12T20:39:08.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-12T20:39:08.351 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:39:08.351 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:39:08.351 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:39:08.355 INFO:tasks.workunit.client.0.trial099.stdout:create new divergent objects 2026-02-12T20:39:08.355 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-12T20:39:08.356 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-12T20:39:08.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:39:08.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:39:08.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-12T20:39:08.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-12T20:39:08.357 INFO:tasks.workunit.client.0.trial099.stdout:writing divergent objects 2026-02-12T20:39:08.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-12T20:39:08.358 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-12T20:39:08.359 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-12T20:39:08.359 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-12T20:39:08.359 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.J03NS5kTsK 2026-02-12T20:39:08.359 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-12T20:39:08.359 INFO:tasks.workunit.client.0.trial099.stdout:remove divergent objects 2026-02-12T20:39:08.360 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.J03NS5kTsK 2026-02-12T20:39:08.360 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-12T20:39:08.360 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-12T20:39:08.360 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-12T20:39:08.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-12T20:39:08.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-12T20:39:08.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-12T20:39:08.361 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-12T20:39:08.362 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-12T20:39:08.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-12T20:39:08.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-12T20:39:18.364 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-12T20:39:18.389 INFO:tasks.workunit.client.0.trial099.stderr:rados: no process found 2026-02-12T20:39:18.389 INFO:tasks.workunit.client.0.trial099.stdout:killing all the osds 2026-02-12T20:39:18.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-12T20:39:18.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:39:18.612 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:39:18.613 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-12T20:38:52.462483+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:19:54.484987+0000 0 0 2026-02-12T20:39:18.613 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:39:18.613 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:39:18.613 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:39:18.620 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-12T20:39:18.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:39:18.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:39:18.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:39:18.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:39:18.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:39:18.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:39:18.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-12T20:39:18.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-12T20:39:19.007 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:39:19.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-12T20:39:19.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-12T20:39:19.315 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:39:19.322 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-12T20:39:19.322 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-12T20:39:19.601 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:39:19.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:19.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-12T20:39:19.887 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already out. 2026-02-12T20:39:19.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:19.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-12T20:39:20.176 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already out. 2026-02-12T20:39:20.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-12T20:39:20.184 INFO:tasks.workunit.client.0.trial099.stdout:bringing up non_divergent 0 2 2026-02-12T20:39:20.184 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:39:20.398 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:39:20.398 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-12T20:38:52.462483+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T08:19:54.484987+0000 0 0 2026-02-12T20:39:20.398 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:39:20.398 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:39:20.398 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:39:20.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:39:20.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:39:20.410 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:39:20.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:39:20.412 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:39:20.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:39:20.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-12T20:39:20.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:39:20.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:39:20.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:39:20.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:39:20.427 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:20.436+0000 7efcf21e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:39:20.428 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:20.437+0000 7efcf21e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:39:20.429 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:20.438+0000 7efcf21e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:39:20.567 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:20.575+0000 7efcf21e3780 -1 Falling back to public interface 2026-02-12T20:39:20.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:39:20.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:39:20.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:39:20.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:39:20.655 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:39:20.655 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:39:20.655 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:39:20.655 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:39:20.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:39:20.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:39:20.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:39:20.898 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:20.907+0000 7efcf21e3780 -1 osd.0 28 log_to_monitors true 2026-02-12T20:39:21.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:39:21.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:39:21.888 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:39:21.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:39:21.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:39:21.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:39:22.117 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3465751042,v1:127.0.0.1:6801/3465751042] [v2:127.0.0.1:6802/3465751042,v1:127.0.0.1:6803/3465751042] exists,up 0c02772d-60e9-4bf9-975b-08ad2ae9ad23 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:39:22.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:39:22.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:39:22.125 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:39:22.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:39:22.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:39:22.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:39:22.127 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:39:22.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:39:22.128 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-12T20:39:22.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:39:22.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:39:22.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:39:22.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:39:22.141 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:22.149+0000 7f124cc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:39:22.142 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:22.151+0000 7f124cc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:39:22.143 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:22.152+0000 7f124cc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:39:22.330 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:22.339+0000 7f124cc2d780 -1 Falling back to public interface 2026-02-12T20:39:22.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:39:22.350 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:39:22.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:39:22.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:39:22.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:39:22.650 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:39:22.659+0000 7f124cc2d780 -1 osd.2 28 log_to_monitors true 2026-02-12T20:39:23.576 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:39:23.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:39:23.577 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:39:23.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:39:23.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:39:23.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:39:23.810 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [15,28) [v2:127.0.0.1:6810/4204275051,v1:127.0.0.1:6811/4204275051] [v2:127.0.0.1:6812/4204275051,v1:127.0.0.1:6813/4204275051] exists,up 018017e1-54f9-4ed4-adff-ca1fdeb1a573 2026-02-12T20:39:23.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:39:23.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:39:23.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:39:23.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:23.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-12T20:39:24.093 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already in. 2026-02-12T20:39:24.100 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:39:24.100 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-12T20:39:24.377 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already in. 2026-02-12T20:39:24.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:39:24.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-12T20:39:24.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:39:24.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:39:24.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:39:24.386 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:39:24.387 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:39:24.387 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:39:24.387 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:39:24.387 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:39:24.387 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:39:24.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:39:24.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:39:24.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:39:24.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:39:24.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:39:24.439 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:39:24.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:39:24.672 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:39:24.672 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:39:24.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:39:24.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:24.672 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:39:24.743 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-12T20:39:24.743 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-12T20:39:24.743 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-12T20:39:24.743 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:24.743 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:39:24.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:39:24.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:39:24.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:39:24.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:39:24.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:24.795 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:39:24.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-12T20:39:24.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-12T20:39:24.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-158913789955' 2026-02-12T20:39:24.864 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:24.864 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-12T20:39:24.864 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:24.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:39:24.866 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-12T20:39:24.866 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:24.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-12T20:39:24.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-12T20:39:24.867 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 150323855363 2026-02-12T20:39:24.867 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:39:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-12T20:39:25.099 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:39:26.100 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:39:26.100 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:39:26.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855364 -lt 150323855363 2026-02-12T20:39:26.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:26.331 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-12T20:39:26.331 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:26.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:39:26.332 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-12T20:39:26.332 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:26.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-12T20:39:26.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-12T20:39:26.334 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 158913789955 2026-02-12T20:39:26.334 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:39:26.567 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-12T20:39:26.568 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:39:26.568 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:26.568 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:26.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:26.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:27.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:27.120 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:27.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:27.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:27.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:27.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:39:27.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:39:27.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:39:27.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:27.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:39:27.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:27.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:27.542 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:27.542 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:27.542 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:27.542 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:27.542 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:27.543 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:27.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:27.769 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:27.770 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:27.770 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:28.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:28.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:28.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:28.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:28.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:28.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:28.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:28.086 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:28.086 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:28.404 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:28.404 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:28.404 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:39:28.405 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:28.405 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:39:28.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:28.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:28.607 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:28.607 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:28.607 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:28.608 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:28.608 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:28.608 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:28.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:28.835 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:28.836 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:28.836 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:29.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:29.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:29.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:29.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:29.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:29.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:29.162 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:29.162 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:29.162 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:29.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:29.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:29.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:39:29.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:29.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:39:29.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:29.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:29.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:29.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:29.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:29.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:29.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:29.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:30.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:30.112 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:30.112 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:30.112 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:30.430 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:30.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:30.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:30.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:30.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:39:30.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:30.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:39:31.553 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:31.553 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:31.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:31.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:31.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:31.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:31.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:31.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:31.783 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:31.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:31.784 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:31.784 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:32.111 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:32.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:32.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:32.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:39:32.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:32.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:39:34.030 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:34.030 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:34.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:34.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:34.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:34.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:34.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:34.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:34.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:34.271 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:34.271 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:34.271 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:34.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:34.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:34.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:34.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:34.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:39:34.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:34.920 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:39:38.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:38.120 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:38.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:38.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:38.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:38.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:38.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:38.122 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:38.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:38.357 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:38.357 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:38.357 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:38.673 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:38.674 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:38.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:38.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:38.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:39:38.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:38.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:39:45.395 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:45.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:45.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:45.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:45.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:45.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:45.398 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:45.398 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:45.626 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:45.626 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:45.627 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:45.627 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:45.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:45.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:45.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:45.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:45.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:45.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:45.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:45.954 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:45.954 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:46.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:46.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:46.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:39:46.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:46.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:39:53.574 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:53.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:53.576 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:53.576 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:53.576 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:53.576 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:53.576 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:53.577 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:53.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:53.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:53.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:53.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:54.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:54.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:54.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:54.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:54.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:54.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:54.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:54.128 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:54.128 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:54.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:54.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:54.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:39:54.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "e7121264-0950-4e64-bb7f-ac9be1c8d4cd", 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:39:54.768800+0000", 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:39:54.760 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:39:54.761 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.762 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.763 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:39:54.764 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:38:43.850305Z", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:38:43.850305Z", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:39:54.765 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:39:54.766 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.767 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:38:43:850301+0000", 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:39:54.768 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 41, 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:38:43.888596+0000", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:39:24.426163+0000", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:39:22.770141+0000", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:39:24.323051+0000", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:39:54.769 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 9, 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:39:54.770 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:38:52.246965+0000", 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 1, 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool", 2026-02-12T20:39:54.771 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 0, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "off", 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 1, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:39:54.772 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 1, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 1, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 1, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "28", 2026-02-12T20:39:54.773 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "0", 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "selfmanaged", 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 0, 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 0, 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [], 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:39:54.774 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "", 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.775 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:39:54.776 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {}, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "read_balance": { 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "score_type": "Fair distribution", 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "score_acting": 2.9900000095367432, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "score_stable": 2.9900000095367432, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_score": 0.67000001668930054, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_acting": 2, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_stable": 2, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity_weighted": 1, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity": 1, 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity_weighted": 1 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.777 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "0c02772d-60e9-4bf9-975b-08ad2ae9ad23", 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 5, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 28, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 35, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 40, 2026-02-12T20:39:54.778 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 29, 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:39:54.779 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.780 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.781 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.782 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/3465751042", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/3465751042", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3465751042", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3465751042", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:39:54.783 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "1fb6d861-89db-4a55-80cb-43e71de5308f", 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 10, 2026-02-12T20:39:54.784 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 22, 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 30, 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:39:54.785 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.786 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.787 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.788 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/4211426563", 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/4211426563", 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4211426563", 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4211426563", 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:39:54.789 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "018017e1-54f9-4ed4-adff-ca1fdeb1a573", 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 15, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 28, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 37, 2026-02-12T20:39:54.790 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 31, 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:39:54.791 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.792 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.793 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:39:54.794 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/4204275051", 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/4204275051", 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4204275051", 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4204275051", 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.795 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:39:18.951837+0000", 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:38:46.319516+0000", 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:39:54.796 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:39:19.256358+0000", 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:38:48.330853+0000", 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:39:19.544330+0000", 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:39:54.797 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:38:51.109379+0000", 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:39:54.798 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:39:54.799 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/3465751042,v1:127.0.0.1:6803/3465751042]", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:39:54.800 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:39:54.801 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:38:44.597650Z", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/3465751042,v1:127.0.0.1:6801/3465751042]", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3465751042,v1:127.0.0.1:6807/3465751042]", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3465751042,v1:127.0.0.1:6805/3465751042]", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:39:54.802 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:39:54.803 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/4211426563,v1:127.0.0.1:6813/4211426563]", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:39:54.804 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:38:46.505354Z", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/4211426563,v1:127.0.0.1:6811/4211426563]", 2026-02-12T20:39:54.805 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4211426563,v1:127.0.0.1:6817/4211426563]", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4211426563,v1:127.0.0.1:6815/4211426563]", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.806 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/4204275051,v1:127.0.0.1:6813/4204275051]", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:39:54.807 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:38:49.126712Z", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/4204275051,v1:127.0.0.1:6811/4204275051]", 2026-02-12T20:39:54.808 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4204275051,v1:127.0.0.1:6817/4204275051]", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4204275051,v1:127.0.0.1:6815/4204275051]", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.809 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 0, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [] 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 35 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 37 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 41, 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:39:54.810 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.811 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.812 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.813 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:39:54.814 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.815 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:39:54.816 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:39:54.817 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:39:54.818 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 0, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:39:54.819 INFO:tasks.workunit.client.0.trial099.stderr:report 4000462454 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:38:43:888423+0000", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:39:54.820 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 1, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:39:54.821 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51200, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 100, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 100, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:39:54.822 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:39:54.823 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 16, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 16, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "up": 2, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 2, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83880, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2096, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 24, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81703, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488920, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036654080, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2146304, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 426569, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:39:54.824 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 25402, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83664070 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:39:54.825 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83880, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2096, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 24, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81703, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488920, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036654080, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2146304, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 426569, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 25402, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83664070 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:39:54.826 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51200, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 100, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 100, 2026-02-12T20:39:54.827 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:39:54.828 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1220608, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 153552, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 16, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 16, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "up": 2, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 2, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 150323855369 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 42949672973 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 158913789961 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:39:54.829 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num": 1 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 1, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.830 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 3, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:39:50.064516+0000", 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "services": { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "osd": { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "daemons": { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "summary": "", 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "0": { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "2": { 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.831 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 36, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 213, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 298, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-12T20:39:54.832 INFO:tasks.workunit.client.0.trial099.stdout:writing non-divergent object existing_4 2026-02-12T20:39:54.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:39:54.987 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:39:54.987 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 28'100 41:130 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:39:54.987 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:39:54.987 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:39:54.988 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:39:54.994 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.J03NS5kTsK 2026-02-12T20:39:55.013 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.J03NS5kTsK 2026-02-12T20:39:55.014 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:39:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-12T20:39:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:39:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:39:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:39:55.015 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:39:55.016 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:39:55.016 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:39:55.016 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:39:55.016 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:39:55.016 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:39:55.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:39:55.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:39:55.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:39:55.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:39:55.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:39:55.068 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:39:55.300 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:39:55.300 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:39:55.300 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:39:55.300 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:39:55.300 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:55.300 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:39:55.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-12T20:39:55.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-12T20:39:55.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-12T20:39:55.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:55.369 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:39:55.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:39:55.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:39:55.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:39:55.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:39:55.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:39:55.420 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:39:55.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-12T20:39:55.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-12T20:39:55.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-158913789963' 2026-02-12T20:39:55.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:55.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-12T20:39:55.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:55.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:39:55.489 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-12T20:39:55.489 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:55.490 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-12T20:39:55.490 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-12T20:39:55.491 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 150323855371 2026-02-12T20:39:55.491 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:39:55.719 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-12T20:39:55.719 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:39:56.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:39:56.721 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:39:56.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855372 -lt 150323855371 2026-02-12T20:39:56.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:39:56.949 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789963 2026-02-12T20:39:56.949 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:39:56.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:39:56.950 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789963 2026-02-12T20:39:56.950 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:39:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-12T20:39:56.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-12T20:39:56.952 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 158913789963 2026-02-12T20:39:56.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:39:57.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-12T20:39:57.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:39:57.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:57.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:57.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:39:57.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:57.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:57.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:57.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:57.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:57.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:57.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:57.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:57.734 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:57.734 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:57.734 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:58.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:58.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:39:58.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:39:58.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:39:58.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:58.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:39:58.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:58.149 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:58.376 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:58.376 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:58.377 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:58.377 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:58.690 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:39:59.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:39:59.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:39:59.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:39:59.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:39:59.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:39:59.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:39:59.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:39:59.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:39:59.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:39:59.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:39:59.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:39:59.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:39:59.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:39:59.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:39:59.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:39:59.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:39:59.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:39:59.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:00.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:00.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:00.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:40:00.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:40:00.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:40:00.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:40:00.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:40:00.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:40:00.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:40:00.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:40:00.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:40:00.478 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:40:00.478 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:40:00.707 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:40:00.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:40:00.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:40:00.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:40:01.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:40:01.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:40:01.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:40:01.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:40:01.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:40:01.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:40:01.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:40:01.029 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:40:01.029 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:01.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:01.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:01.342 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:40:01.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:40:01.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:40:02.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:40:02.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:40:02.144 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:40:02.144 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:40:02.144 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:40:02.145 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:40:02.145 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:40:02.145 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:40:02.377 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:40:02.378 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:40:02.378 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:40:02.378 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:40:02.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:40:02.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:40:02.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:40:02.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:40:02.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:40:02.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:40:02.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:40:02.698 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:40:02.698 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:03.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:03.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:03.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:40:03.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:40:03.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:40:04.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:40:04.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:40:04.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:40:04.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:40:04.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:40:04.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:40:04.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:40:04.615 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:40:04.846 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:40:04.846 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:40:04.847 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:40:04.847 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:40:05.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:40:05.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:40:05.167 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:05.487 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:05.487 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:05.487 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:40:05.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:40:05.488 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:40:08.688 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:40:08.688 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:40:08.689 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:40:08.689 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:40:08.689 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:40:08.689 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:40:08.689 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:40:08.689 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:40:08.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:40:08.919 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:40:08.919 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:40:08.919 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:40:09.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:40:09.254 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:09.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:09.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:09.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:40:09.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:40:09.576 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:40:15.976 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:40:15.976 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:40:15.977 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:40:15.977 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:40:15.977 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:40:15.977 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:40:15.978 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:40:15.978 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:40:16.203 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:40:16.204 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:40:16.204 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:40:16.204 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:40:16.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:40:16.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:40:16.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:40:16.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:40:16.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:40:16.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:40:16.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:40:16.528 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:40:16.528 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:16.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:16.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:16.851 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:40:16.851 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:40:16.851 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:40:24.151 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:40:24.151 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:40:24.152 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:40:24.152 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:40:24.152 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:40:24.153 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:40:24.153 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:40:24.153 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:40:24.380 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:40:24.380 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:40:24.381 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:40:24.381 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:40:24.708 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:40:24.709 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:40:25.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:40:25.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:40:25.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:40:25.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:40:25.338 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:40:25.338 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "e7121264-0950-4e64-bb7f-ac9be1c8d4cd", 2026-02-12T20:40:25.338 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:40:25.338 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:40:25.338 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:40:25.346818+0000", 2026-02-12T20:40:25.338 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:40:25.339 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.340 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.341 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:38:43.850305Z", 2026-02-12T20:40:25.342 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:38:43.850305Z", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:40:25.343 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.344 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:40:25.345 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:38:43:850301+0000", 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:40:25.346 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 41, 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:38:43.888596+0000", 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:39:24.426163+0000", 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:39:22.770141+0000", 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:39:24.323051+0000", 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:40:25.347 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 9, 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:40:25.348 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:38:52.246965+0000", 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 1, 2026-02-12T20:40:25.349 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool", 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 0, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "off", 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 1, 2026-02-12T20:40:25.350 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 1, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 1, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 1, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "28", 2026-02-12T20:40:25.351 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "0", 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "selfmanaged", 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 0, 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 0, 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [], 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:40:25.352 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "", 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:40:25.353 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:40:25.354 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {}, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "read_balance": { 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "score_type": "Fair distribution", 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "score_acting": 2.9900000095367432, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "score_stable": 2.9900000095367432, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_score": 0.67000001668930054, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_acting": 2, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_stable": 2, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity_weighted": 1, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity": 1, 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity_weighted": 1 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.355 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "0c02772d-60e9-4bf9-975b-08ad2ae9ad23", 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 5, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 28, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 35, 2026-02-12T20:40:25.356 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 40, 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 29, 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.357 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.358 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.359 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:40:25.360 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3465751042 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/3465751042", 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/3465751042", 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3465751042", 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3465751042", 2026-02-12T20:40:25.361 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "1fb6d861-89db-4a55-80cb-43e71de5308f", 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:40:25.362 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 10, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 22, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 30, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.363 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.365 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:40:25.366 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4211426563 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/4211426563", 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/4211426563", 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4211426563", 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4211426563", 2026-02-12T20:40:25.367 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "018017e1-54f9-4ed4-adff-ca1fdeb1a573", 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 15, 2026-02-12T20:40:25.368 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 28, 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 37, 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 31, 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.369 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.370 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.371 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4204275051 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/4204275051", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/4204275051", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4204275051", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4204275051", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:40:25.373 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:39:18.951837+0000", 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:38:46.319516+0000", 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.374 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:39:19.256358+0000", 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:38:48.330853+0000", 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:39:19.544330+0000", 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:40:25.375 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:38:51.109379+0000", 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:40:25.376 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:40:25.377 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/3465751042,v1:127.0.0.1:6803/3465751042]", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:40:25.378 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:38:44.597650Z", 2026-02-12T20:40:25.379 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/3465751042,v1:127.0.0.1:6801/3465751042]", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3465751042,v1:127.0.0.1:6807/3465751042]", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3465751042,v1:127.0.0.1:6805/3465751042]", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:40:25.380 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/4211426563,v1:127.0.0.1:6813/4211426563]", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:40:25.381 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:40:25.382 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:38:46.505354Z", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/4211426563,v1:127.0.0.1:6811/4211426563]", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4211426563,v1:127.0.0.1:6817/4211426563]", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4211426563,v1:127.0.0.1:6815/4211426563]", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:40:25.383 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/4204275051,v1:127.0.0.1:6813/4204275051]", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:40:25.384 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:38:49.126712Z", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:40:25.385 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/4204275051,v1:127.0.0.1:6811/4204275051]", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4204275051,v1:127.0.0.1:6817/4204275051]", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4204275051,v1:127.0.0.1:6815/4204275051]", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:40:25.386 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 0, 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [] 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 35 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 37 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.387 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 41, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.388 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.389 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.390 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.391 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:40:25.392 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:40:25.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.394 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:40:25.395 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 0, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:40:25.396 INFO:tasks.workunit.client.0.trial099.stderr:report 3772254603 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:38:43:888423+0000", 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:40:25.397 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 1, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:40:25.398 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51688, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:40:25.399 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 17, 2026-02-12T20:40:25.400 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 17, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "up": 2, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 2, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83880, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2096, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 24, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81703, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488920, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036654080, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2146304, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 427545, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 25402, 2026-02-12T20:40:25.401 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83664070 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83880, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2096, 2026-02-12T20:40:25.402 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 24, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81703, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488920, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036654080, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2146304, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 427545, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 25402, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83664070 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:40:25.403 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51688, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:40:25.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1220608, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 154528, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.405 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 17, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 17, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "up": 2, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 2, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 150323855377 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 42949672973 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 158913789969 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "num": 1 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.406 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 1, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 5, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:40:24.068621+0000", 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "services": {} 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:40:25.407 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 51, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 279, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 379, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery 2026-02-12T20:40:25.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:25.570 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:25.570 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 41:131 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:25.570 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:25.570 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:25.570 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:25.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:40:25.578 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:40:25.579 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-12T20:40:25.579 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok set_recovery_delay 100000 2026-02-12T20:40:25.625 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:40:25.629 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-12T20:40:25.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-12T20:40:25.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:40:25.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:40:25.630 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:40:25.630 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:40:25.630 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:40:25.631 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:40:25.631 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-12T20:40:25.631 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok set_recovery_delay 100000 2026-02-12T20:40:25.676 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:40:25.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-12T20:40:25.680 INFO:tasks.workunit.client.0.trial099.stdout:revive divergent 1 2026-02-12T20:40:25.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:25.898 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:25.898 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 41:131 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:25.898 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:25.899 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:25.899 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:25.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-12T20:40:26.235 INFO:tasks.workunit.client.0.trial099.stderr:noup is set 2026-02-12T20:40:26.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-12T20:40:26.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:40:26.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:40:26.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:40:26.253 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:40:26.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:40:26.254 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:40:26.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:40:26.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:40:26.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:40:26.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:40:26.269 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:26.278+0000 7f3869848780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:40:26.271 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:26.279+0000 7f3869848780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:40:26.272 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:26.280+0000 7f3869848780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:40:26.433 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:26.442+0000 7f3869848780 -1 Falling back to public interface 2026-02-12T20:40:26.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-12T20:40:26.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-12T20:40:26.710 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:26.719+0000 7f3869848780 -1 osd.1 28 log_to_monitors true 2026-02-12T20:40:31.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-12T20:40:31.482 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery divergent 2026-02-12T20:40:31.482 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:31.700 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:31.700 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 41:131 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:31.700 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:31.700 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:31.700 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:40:31.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:40:31.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-12T20:40:31.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok set_recovery_delay 100000 2026-02-12T20:40:31.754 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:40:31.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-12T20:40:32.074 INFO:tasks.workunit.client.0.trial099.stderr:noup is unset 2026-02-12T20:40:32.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-12T20:40:32.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:40:32.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:40:32.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:40:32.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:40:32.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:40:32.086 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:40:32.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:40:32.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:40:32.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:40:32.315 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 35 up_thru 40 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3465751042,v1:127.0.0.1:6801/3465751042] [v2:127.0.0.1:6802/3465751042,v1:127.0.0.1:6803/3465751042] exists,up 0c02772d-60e9-4bf9-975b-08ad2ae9ad23 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:40:32.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:40:32.318 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:40:32.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:40:32.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:40:32.545 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/2133795203,v1:127.0.0.1:6819/2133795203] [v2:127.0.0.1:6820/2133795203,v1:127.0.0.1:6821/2133795203] exists,up 1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:40:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:40:32.547 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:40:32.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:40:32.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:40:32.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:40:32.776 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 31 last_clean_interval [15,28) [v2:127.0.0.1:6810/4204275051,v1:127.0.0.1:6811/4204275051] [v2:127.0.0.1:6812/4204275051,v1:127.0.0.1:6813/4204275051] exists,up 018017e1-54f9-4ed4-adff-ca1fdeb1a573 2026-02-12T20:40:32.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:40:32.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:40:32.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:40:32.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:32.996 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:32.996 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:32.996 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:32.996 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:32.996 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:33.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-12T20:40:33.003 INFO:tasks.workunit.client.0.trial099.stdout:wait for peering 2026-02-12T20:40:33.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:33.222 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:33.223 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:33.223 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:33.223 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:33.223 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:33.230 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.b1bzb2mlRC 2026-02-12T20:40:33.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.b1bzb2mlRC 2026-02-12T20:40:33.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-12T20:40:33.252 INFO:tasks.workunit.client.0.trial099.stdout:killing divergent 1 2026-02-12T20:40:33.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:33.469 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:33.469 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:33.469 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:33.469 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:33.470 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:33.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-12T20:40:33.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:40:33.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:40:33.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:40:33.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:40:33.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.24351.out 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.24351.out 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-12T20:40:33.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.24351.out 2026-02-12T20:40:33.683 INFO:tasks.workunit.client.0.trial099.stderr:Exporting 1.0 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=46/47 n=101 ec=22/22 lis/c=46/22 les/c/f=47/23/0 sis=46) 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-12T20:40:33.707 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:169157fa:::existing_81:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:17731382:::existing_58:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:28566edb:::existing_78:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:2a101182:::existing_20:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-12T20:40:33.708 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:53588912:::existing_9:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-12T20:40:33.709 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:602f83fe:::foo:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:628918ca:::existing_79:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:750ace21:::existing_19:head# 2026-02-12T20:40:33.710 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:79881152:::existing_63:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:81490677:::existing_76:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:92731e71:::existing_89:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:928205cf:::existing_82:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:93be2267:::existing_24:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-12T20:40:33.711 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a504a533:::existing_90:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a691337e:::existing_61:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:b343e277:::existing_88:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-12T20:40:33.712 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:bebec877:::existing_74:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:c156033e:::existing_100:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-12T20:40:33.713 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:e255b710:::existing_55:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:f6809456:::existing_11:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-12T20:40:33.714 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-12T20:40:33.715 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-12T20:40:33.715 INFO:tasks.workunit.client.0.trial099.stderr:Export successful 2026-02-12T20:40:33.715 INFO:tasks.workunit.client.0.trial099.stdout: marking collection for removal 2026-02-12T20:40:33.715 INFO:tasks.workunit.client.0.trial099.stdout:setting '_remove' omap key 2026-02-12T20:40:33.715 INFO:tasks.workunit.client.0.trial099.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-12T20:40:33.716 INFO:tasks.workunit.client.0.trial099.stderr:Remove successful 2026-02-12T20:40:33.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.24351.out 2026-02-12T20:40:33.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:40:33.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:40:33.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-12T20:40:33.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:40:33.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-12T20:40:33.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.24351.out 2026-02-12T20:40:33.847 INFO:tasks.workunit.client.0.trial099.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={22=1}} deleted_pools ) 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:Importing pgid 1.0 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-12T20:40:33.848 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:169157fa:::existing_81:head# 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:17731382:::existing_58:head# 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-12T20:40:33.849 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:28566edb:::existing_78:head# 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:2a101182:::existing_20:head# 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-12T20:40:33.850 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-12T20:40:33.851 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:53588912:::existing_9:head# 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.852 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:602f83fe:::foo:head# 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:628918ca:::existing_79:head# 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.853 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-12T20:40:33.854 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:750ace21:::existing_19:head# 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:79881152:::existing_63:head# 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:81490677:::existing_76:head# 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.855 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:92731e71:::existing_89:head# 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:928205cf:::existing_82:head# 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:93be2267:::existing_24:head# 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.856 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a504a533:::existing_90:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a691337e:::existing_61:head# 2026-02-12T20:40:33.857 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:b343e277:::existing_88:head# 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.858 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:bebec877:::existing_74:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:c156033e:::existing_100:head# 2026-02-12T20:40:33.859 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.860 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-12T20:40:33.861 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:e255b710:::existing_55:head# 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:f6809456:::existing_11:head# 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.862 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:write_pg epoch 47 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=46/47 n=101 ec=22/22 lis/c=46/22 les/c/f=47/23/0 sis=46) 2026-02-12T20:40:33.863 INFO:tasks.workunit.client.0.trial099.stdout:Import successful 2026-02-12T20:40:33.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-12T20:40:33.884 INFO:tasks.workunit.client.0.trial099.stdout:reviving divergent 1 2026-02-12T20:40:33.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:34.110 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:34.110 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:39:24.429628+0000 41'101 44:137 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:00:29.027134+0000 0 0 2026-02-12T20:40:34.111 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:34.111 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:34.111 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:34.122 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-12T20:40:34.122 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:40:34.122 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:40:34.122 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:40:34.122 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:40:34.122 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:40:34.123 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:40:34.124 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:40:34.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:40:34.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:40:34.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:40:34.125 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:40:34.125 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:40:34.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:40:34.126 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:40:34.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:40:34.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:40:34.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:40:34.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:40:34.141 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:34.150+0000 7fc925436780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:40:34.142 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:34.151+0000 7fc925436780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:40:34.143 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:34.152+0000 7fc925436780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:40:34.314 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:34.322+0000 7fc925436780 -1 Falling back to public interface 2026-02-12T20:40:34.355 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:40:34.355 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:40:34.355 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:40:34.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:40:34.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:40:34.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:40:34.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:40:34.356 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:40:34.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:40:34.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:40:34.587 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/2133795203,v1:127.0.0.1:6819/2133795203] [v2:127.0.0.1:6820/2133795203,v1:127.0.0.1:6821/2133795203] exists,up 1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:40:34.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:40:34.589 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:40:34.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:40:34.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:40:34.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:40:34.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:40:34.628 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:40:34.637+0000 7fc925436780 -1 osd.1 47 log_to_monitors true 2026-02-12T20:40:34.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:40:35.824 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:40:35.824 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:40:35.824 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:40:35.824 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:40:35.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:40:35.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:40:36.053 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 49 last_clean_interval [46,47) [v2:127.0.0.1:6818/3216863513,v1:127.0.0.1:6819/3216863513] [v2:127.0.0.1:6820/3216863513,v1:127.0.0.1:6821/3216863513] exists,up 1fb6d861-89db-4a55-80cb-43e71de5308f 2026-02-12T20:40:36.054 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:40:36.054 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:40:36.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:40:36.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-12T20:40:56.055 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:40:56.056 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-12T20:40:56.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok dump_ops_in_flight 2026-02-12T20:40:56.102 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:40:56.102 INFO:tasks.workunit.client.0.trial099.stdout: "ops": [], 2026-02-12T20:40:56.102 INFO:tasks.workunit.client.0.trial099.stdout: "num_ops": 0 2026-02-12T20:40:56.102 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:40:56.106 INFO:tasks.workunit.client.0.trial099.stdout:allowing recovery 2026-02-12T20:40:56.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-12T20:40:56.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:56.323 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:56.323 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-12T20:40:34.967180+0000 47'102 51:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-13T22:49:34.054491+0000 0 0 2026-02-12T20:40:56.323 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:56.323 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:56.324 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:56.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-12T20:40:56.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-12T20:40:56.392 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:40:56.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-12T20:40:56.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-12T20:40:56.459 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:40:56.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-12T20:40:56.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-12T20:40:56.524 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:40:56.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-12T20:40:56.530 INFO:tasks.workunit.client.0.trial099.stdout:reading divergent objects 2026-02-12T20:40:56.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-12T20:40:56.747 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:40:56.747 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-12T20:40:34.967180+0000 47'102 51:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:38:52.273344+0000 0'0 2026-02-12T20:38:52.273344+0000 0 0 periodic scrub scheduled @ 2026-02-13T22:49:34.054491+0000 0 0 2026-02-12T20:40:56.747 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:40:56.747 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:40:56.747 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:40:56.755 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-12T20:40:56.756 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-12T20:40:56.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:40:56.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-12T20:40:56.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:40:56.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-12T20:40:56.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:40:56.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-12T20:40:56.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:40:56.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-12T20:40:56.834 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-12T20:40:56.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:40:56.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-12T20:40:56.852 INFO:tasks.workunit.client.0.trial099.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-12T20:40:56.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:40:56.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-12T20:40:56.870 INFO:tasks.workunit.client.0.trial099.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-12T20:40:56.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-12T20:40:56.873 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-12T20:40:56.874 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-12T20:39:08.390742+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-12T20:39:08.390742+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: more recent entry found: 41'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4656.0:1 2026-02-12T20:39:55.020978+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-12T20:39:08.385260+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-12T20:39:08.385260+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-12T20:40:56.877 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-12T20:39:08.389868+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-12T20:39:08.389868+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-12T20:39:08.389868+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-12T20:39:08.387352+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: keeping 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-12T20:39:08.387352+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-12T20:39:08.387352+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-12T20:39:08.386800+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:40:56.878 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: keeping 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-12T20:39:08.386800+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-12T20:39:08.386800+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-12T20:39:08.384216+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-12T20:39:08.384216+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-12T20:40:56.879 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:40:32.522+0000 7f38471fd640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-12T20:40:56.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-12T20:40:56.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:40:56.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-12T20:40:56.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:40:56.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-12T20:40:56.886 INFO:tasks.workunit.client.0.trial099.stdout:success 2026-02-12T20:40:56.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.24351.out 2026-02-12T20:40:56.887 INFO:tasks.workunit.client.0.trial099.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.24351.out': No such file or directory 2026-02-12T20:40:56.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-12T20:40:56.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-12T20:40:56.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-12T20:40:57.171 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' does not exist 2026-02-12T20:40:57.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-12T20:40:57.179 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:40:57.179 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:40:57.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:40:57.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:40:57.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:41:02.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:41:02.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-12T20:41:02.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:41:02.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:41:02.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:41:02.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:41:02.495 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:41:02.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:41:02.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:41:02.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:41:02.500 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:41:02.500 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:41:02.500 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:41:02.501 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:41:02.502 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:41:02.502 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:41:02.502 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:41:02.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:41:02.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:41:02.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:41:02.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:41:02.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:41:02.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:41:02.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:41:02.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:41:02.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:41:02.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:41:02.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:41:02.524 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:41:02.524 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:41:02.524 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:41:02.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:41:02.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:41:02.526 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:41:02.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:41:02.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:41:02.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:41:02.527 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:41:02.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:41:02.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:41:02.529 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:41:02.530 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:41:02.530 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.530 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:41:02.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:41:02.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:41:02.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-12T20:41:02.532 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:41:02.532 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.532 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.24351 2026-02-12T20:41:02.533 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:41:02.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-12T20:41:02.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:41:02.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-12T20:41:02.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-12T20:41:02.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-12T20:41:02.535 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-12T20:41:02.535 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-12T20:41:02.535 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:41:02.535 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.gZYONuQv1s 2026-02-12T20:41:02.535 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.gZYONuQv1s bs=512 count=1 2026-02-12T20:41:02.536 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:41:02.536 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:41:02.536 INFO:tasks.workunit.client.0.trial099.stderr:512 bytes copied, 0.000132406 s, 3.9 MB/s 2026-02-12T20:41:02.536 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:02.536 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.gZYONuQv1s 2026-02-12T20:41:02.537 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-12T20:41:02.537 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-12T20:41:02.537 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:41:02.538 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.2z99u29wCO 2026-02-12T20:41:02.538 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.2z99u29wCO bs=1000 count=1 2026-02-12T20:41:02.539 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:41:02.539 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:41:02.539 INFO:tasks.workunit.client.0.trial099.stderr:1000 bytes (1.0 kB) copied, 7.6181e-05 s, 13.1 MB/s 2026-02-12T20:41:02.539 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.2z99u29wCO 2026-02-12T20:41:02.539 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.2z99u29wCO 2026-02-12T20:41:02.539 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-12T20:41:02.540 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-12T20:41:02.540 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-12T20:41:02.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-12T20:41:02.541 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-12T20:41:02.542 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-12T20:41:02.562 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:02.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:41:02.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:41:02.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:41:02.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:41:02.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:41:02.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:41:02.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:41:02.592 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get fsid 2026-02-12T20:41:02.634 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:41:02.634 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:41:02.635 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:41:02.635 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:41:02.635 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:41:02.636 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:41:02.636 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:41:02.636 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:41:02.636 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:41:02.636 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.636 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.637 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:41:02.637 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:41:02.637 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get mon_host 2026-02-12T20:41:02.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-12T20:41:02.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-12T20:41:02.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:41:02.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:41:02.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:41:02.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-12T20:41:02.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.783 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:02.784 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:41:02.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:41:02.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:02.807 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:41:02.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:41:02.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:41:02.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:41:02.809 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:41:02.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=46fb6b4a-ed00-419c-8eab-b8399a4943ba 2026-02-12T20:41:02.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 46fb6b4a-ed00-419c-8eab-b8399a4943ba' 2026-02-12T20:41:02.810 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 46fb6b4a-ed00-419c-8eab-b8399a4943ba 2026-02-12T20:41:02.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:41:02.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDeOo5p+7RSMRAACu2LDz1vBvWsqnrZfW9N0g== 2026-02-12T20:41:02.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDeOo5p+7RSMRAACu2LDz1vBvWsqnrZfW9N0g=="}' 2026-02-12T20:41:02.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 46fb6b4a-ed00-419c-8eab-b8399a4943ba -i td/divergent-priors/0/new.json 2026-02-12T20:41:02.922 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:41:02.928 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-12T20:41:02.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDeOo5p+7RSMRAACu2LDz1vBvWsqnrZfW9N0g== --osd-uuid 46fb6b4a-ed00-419c-8eab-b8399a4943ba 2026-02-12T20:41:02.950 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:02.958+0000 7f0924210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:02.951 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:02.960+0000 7f0924210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:02.952 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:02.961+0000 7f0924210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:02.953 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:02.961+0000 7f0924210780 -1 bdev(0x37e4c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:41:02.953 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:02.961+0000 7f0924210780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-12T20:41:03.381 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-12T20:41:03.381 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:41:03.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:41:03.382 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:41:03.383 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:41:03.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:41:03.490 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:41:03.490 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:41:03.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:41:03.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:41:03.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:41:03.510 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:03.518+0000 7fb2b7c4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:03.511 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:03.520+0000 7fb2b7c4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:03.512 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:03.520+0000 7fb2b7c4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:03.593 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:41:03.593 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:41:03.593 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:41:03.594 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:41:03.594 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:41:03.594 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:03.594 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:41:03.594 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:41:03.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:03.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:41:03.694 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:41:03.729 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:03.738+0000 7fb2b7c4f780 -1 Falling back to public interface 2026-02-12T20:41:04.084 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:04.093+0000 7fb2b7c4f780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:41:04.696 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:41:04.696 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:04.696 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:41:04.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:41:04.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:04.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:41:04.801 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/718694502,v1:127.0.0.1:6801/718694502] [v2:127.0.0.1:6802/718694502,v1:127.0.0.1:6803/718694502] exists,up 46fb6b4a-ed00-419c-8eab-b8399a4943ba 2026-02-12T20:41:04.805 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:41:04.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:04.807 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:41:04.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:41:04.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:41:04.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:41:04.809 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:41:04.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:41:04.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 bfb77b03-7b3c-4840-9f05-34cc73b7a065' 2026-02-12T20:41:04.809 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:41:04.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:41:04.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDgOo5ppW1KMRAAqSfyBExAGUcvhNYpI2QwaQ== 2026-02-12T20:41:04.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDgOo5ppW1KMRAAqSfyBExAGUcvhNYpI2QwaQ=="}' 2026-02-12T20:41:04.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bfb77b03-7b3c-4840-9f05-34cc73b7a065 -i td/divergent-priors/1/new.json 2026-02-12T20:41:04.923 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:41:04.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-12T20:41:04.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDgOo5ppW1KMRAAqSfyBExAGUcvhNYpI2QwaQ== --osd-uuid bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:41:04.949 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:04.958+0000 7f69721e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:04.951 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:04.959+0000 7f69721e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:04.951 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:04.960+0000 7f69721e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:04.952 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:04.960+0000 7f69721e1780 -1 bdev(0x2af0c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:41:04.952 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:04.961+0000 7f69721e1780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-12T20:41:05.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-12T20:41:05.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:41:05.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:41:05.267 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:41:05.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:41:05.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:41:05.586 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:41:05.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:41:05.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:41:05.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:41:05.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:41:05.605 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:05.613+0000 7f5cd4815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:05.606 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:05.615+0000 7f5cd4815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:05.607 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:05.616+0000 7f5cd4815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:05.732 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:05.740+0000 7f5cd4815780 -1 Falling back to public interface 2026-02-12T20:41:05.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:41:05.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:41:05.816 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:41:05.817 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:41:05.817 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:41:05.817 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:05.817 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:41:05.817 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:41:05.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:05.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:41:06.032 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:06.041+0000 7f5cd4815780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:41:06.046 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:41:07.048 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:41:07.048 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:07.049 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:41:07.049 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:41:07.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:07.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:41:07.280 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/279077078,v1:127.0.0.1:6811/279077078] [v2:127.0.0.1:6812/279077078,v1:127.0.0.1:6813/279077078] exists,up bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:41:07.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:41:07.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:41:07.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:41:07.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-12T20:41:07.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:41:07.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:07.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:41:07.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:41:07.289 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:41:07.289 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:41:07.289 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7f0a1efd-064c-441f-852a-5a313dff7318 2026-02-12T20:41:07.289 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7f0a1efd-064c-441f-852a-5a313dff7318' 2026-02-12T20:41:07.289 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 7f0a1efd-064c-441f-852a-5a313dff7318 2026-02-12T20:41:07.290 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:41:07.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDjOo5pC+QqEhAAi8JFqLe/BVla0clwL0RQFw== 2026-02-12T20:41:07.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDjOo5pC+QqEhAAi8JFqLe/BVla0clwL0RQFw=="}' 2026-02-12T20:41:07.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7f0a1efd-064c-441f-852a-5a313dff7318 -i td/divergent-priors/2/new.json 2026-02-12T20:41:07.532 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:41:07.540 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-12T20:41:07.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDjOo5pC+QqEhAAi8JFqLe/BVla0clwL0RQFw== --osd-uuid 7f0a1efd-064c-441f-852a-5a313dff7318 2026-02-12T20:41:07.560 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:07.569+0000 7fdcd083c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:07.562 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:07.571+0000 7fdcd083c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:07.563 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:07.571+0000 7fdcd083c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:07.563 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:07.572+0000 7fdcd083c780 -1 bdev(0x4386c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:41:07.563 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:07.572+0000 7fdcd083c780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-12T20:41:07.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-12T20:41:07.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:41:07.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:41:07.877 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:41:07.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:41:08.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:41:08.195 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:41:08.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:41:08.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:41:08.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:41:08.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:41:08.213 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:08.222+0000 7f7f8fdfb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:08.214 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:08.223+0000 7f7f8fdfb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:08.215 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:08.224+0000 7f7f8fdfb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:08.345 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:08.353+0000 7f7f8fdfb780 -1 Falling back to public interface 2026-02-12T20:41:08.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:08.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:41:08.625 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:08.633+0000 7f7f8fdfb780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:41:08.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:41:09.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:41:09.666 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:09.666 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:41:09.666 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:41:09.666 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:09.666 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:41:09.897 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/278256827,v1:127.0.0.1:6819/278256827] [v2:127.0.0.1:6820/278256827,v1:127.0.0.1:6821/278256827] exists,up 7f0a1efd-064c-441f-852a-5a313dff7318 2026-02-12T20:41:09.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:41:09.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:41:09.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:41:09.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-12T20:41:10.215 INFO:tasks.workunit.client.0.trial099.stderr:noout is set 2026-02-12T20:41:10.222 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-12T20:41:10.518 INFO:tasks.workunit.client.0.trial099.stderr:noin is set 2026-02-12T20:41:10.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-12T20:41:10.822 INFO:tasks.workunit.client.0.trial099.stderr:nodown is set 2026-02-12T20:41:10.830 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-12T20:41:10.830 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-12T20:41:11.088 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' already exists 2026-02-12T20:41:11.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:41:12.097 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-12T20:41:12.409 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 size to 3 2026-02-12T20:41:12.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-12T20:41:12.712 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 min_size to 2 2026-02-12T20:41:12.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-12T20:41:13.018 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 pg_autoscale_mode to on 2026-02-12T20:41:13.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-12T20:41:13.027 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-12T20:41:13.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1770928873 2026-02-12T20:41:13.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-12T20:41:13.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-12T20:41:13.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-12T20:41:13.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:41:13.028 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:41:13.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:41:13.255 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:41:13.255 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:41:13.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:41:13.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:13.255 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:41:13.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-12T20:41:13.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-12T20:41:13.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-12T20:41:13.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:13.324 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:41:13.392 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-12T20:41:13.392 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-12T20:41:13.392 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-12T20:41:13.393 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:13.393 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:41:13.461 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-12T20:41:13.461 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-12T20:41:13.461 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-12T20:41:13.461 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:13.462 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-12T20:41:13.462 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:13.463 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:41:13.463 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-12T20:41:13.463 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:13.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-12T20:41:13.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-12T20:41:13.464 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836484 2026-02-12T20:41:13.465 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:13.693 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:41:13.693 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:41:14.694 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:41:14.694 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:14.941 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-12T20:41:14.941 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:14.941 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-12T20:41:14.941 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:14.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:41:14.943 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-12T20:41:14.943 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:14.944 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-12T20:41:14.944 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-12T20:41:14.944 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705668 2026-02-12T20:41:14.944 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:41:15.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-12T20:41:15.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:15.173 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-12T20:41:15.173 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:15.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:41:15.175 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-12T20:41:15.175 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:15.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-12T20:41:15.176 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 55834574851 2026-02-12T20:41:15.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-12T20:41:15.176 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:41:15.403 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:41:15.404 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:41:15.404 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:41:15.404 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:41:15.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:41:15.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:41:15.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:41:15.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:41:15.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:41:15.492 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:41:15.727 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:41:15.727 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:41:15.727 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:41:15.727 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:41:15.727 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:15.727 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:41:15.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-12T20:41:15.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-12T20:41:15.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-12T20:41:15.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:15.797 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:41:15.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-12T20:41:15.865 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-12T20:41:15.866 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-12T20:41:15.866 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:15.866 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:41:15.932 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-12T20:41:15.932 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-12T20:41:15.932 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-12T20:41:15.932 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:15.933 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-12T20:41:15.933 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:15.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:41:15.934 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-12T20:41:15.934 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:15.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-12T20:41:15.935 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-12T20:41:15.935 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836487 2026-02-12T20:41:15.935 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:16.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-12T20:41:16.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:41:17.168 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:41:17.169 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:17.398 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-12T20:41:17.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:17.399 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-12T20:41:17.399 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:17.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:41:17.401 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-12T20:41:17.401 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:17.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-12T20:41:17.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-12T20:41:17.402 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705670 2026-02-12T20:41:17.403 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:41:17.629 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-12T20:41:17.630 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:17.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574854 2026-02-12T20:41:17.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:17.631 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:41:17.632 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-12T20:41:17.632 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:17.633 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574854 2026-02-12T20:41:17.633 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-12T20:41:17.634 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 55834574854 2026-02-12T20:41:17.634 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:41:17.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-12T20:41:17.868 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:41:17.868 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:17.868 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:18.184 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:41:18.184 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:18.184 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:18.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:18.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:18.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:18.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:18.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:18.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:41:18.409 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:18.409 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:18.409 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:18.724 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:41:18.724 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:41:18.724 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:41:18.724 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-12T20:41:18.725 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-12T20:41:18.942 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:41:18.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-12T20:41:18.950 INFO:tasks.workunit.client.0.trial099.stdout:primary and soon to be divergent is 1 2026-02-12T20:41:18.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-12T20:41:18.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:41:19.167 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:41:19.167 INFO:tasks.workunit.client.0.trial099.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-12T20:41:11.145306+0000 0'0 29:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:29:14.098169+0000 0 0 2026-02-12T20:41:19.167 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:41:19.167 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:41:19.167 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:41:19.175 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-12T20:41:19.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1770928879 2026-02-12T20:41:19.176 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1770928879 - 1770928873 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=6 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 6 -gt 300 ']' 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-12T20:41:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stdout:writing initial objects 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.198 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.198 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.219 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.219 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.298 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.298 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.338 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.338 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.376 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.376 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.395 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.395 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.451 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.451 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.470 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.471 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.508 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.508 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.565 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.565 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.602 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.602 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.717 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.772 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.772 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.847 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.848 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.906 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.906 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.925 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.925 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.943 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.943 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:19.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:19.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.020 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.020 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.038 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.039 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.076 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.076 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.114 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.114 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.152 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.152 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.171 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.171 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.190 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.230 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.230 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.305 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.325 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.325 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.383 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.459 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.459 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.496 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.496 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.533 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.533 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.551 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.551 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.627 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.627 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.740 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.740 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.778 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.797 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.817 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.817 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.837 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.837 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:20.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:20.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:21.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:21.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:21.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:21.029 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:21.048 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:21.048 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:21.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-12T20:41:21.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.gZYONuQv1s 2026-02-12T20:41:21.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:41:21.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:41:21.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:41:21.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:41:21.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:41:21.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:41:21.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:41:21.141 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:41:21.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:41:21.368 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:41:21.368 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:41:21.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:41:21.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:21.369 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:41:21.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-12T20:41:21.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-12T20:41:21.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-12T20:41:21.436 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:21.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:41:21.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-12T20:41:21.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-12T20:41:21.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-12T20:41:21.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:21.506 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:41:21.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-12T20:41:21.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-12T20:41:21.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-55834574857' 2026-02-12T20:41:21.577 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:21.577 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-12T20:41:21.577 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:21.578 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:41:21.578 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-12T20:41:21.579 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:21.580 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-12T20:41:21.580 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-12T20:41:21.580 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836490 2026-02-12T20:41:21.581 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:21.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-12T20:41:21.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:41:22.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:41:22.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:23.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-12T20:41:23.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:23.051 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-12T20:41:23.051 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:23.051 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:41:23.052 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-12T20:41:23.052 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:23.053 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-12T20:41:23.054 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-12T20:41:23.054 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705673 2026-02-12T20:41:23.054 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:41:23.283 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-12T20:41:23.284 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:23.284 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574857 2026-02-12T20:41:23.285 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:23.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:41:23.286 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-12T20:41:23.286 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:23.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574857 2026-02-12T20:41:23.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-12T20:41:23.287 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 55834574857 2026-02-12T20:41:23.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:41:23.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-12T20:41:23.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:41:23.521 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:23.521 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:23.847 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:41:23.847 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:23.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:23.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:23.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:23.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:23.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:23.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:24.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:41:24.075 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:24.076 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:24.076 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:24.393 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-12T20:41:24.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-12T20:41:24.635 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-12T20:41:24.635 INFO:tasks.workunit.client.0.trial099.stdout:blackholing osds 0 2 2026-02-12T20:41:24.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-12T20:41:24.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:41:24.853 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:41:24.853 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-12T20:41:11.145306+0000 29'100 29:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:29:14.098169+0000 0 0 2026-02-12T20:41:24.853 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:41:24.853 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:41:24.853 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:41:24.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:24.861 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-12T20:41:24.861 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:41:24.861 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:41:24.861 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:41:24.861 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:24.861 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:24.862 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:41:24.862 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-12T20:41:24.862 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-12T20:41:24.907 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:41:24.907 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:41:24.908 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:41:24.911 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:24.913 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-12T20:41:24.913 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:41:24.913 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:41:24.913 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:41:24.913 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:24.913 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:24.914 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:41:24.914 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-12T20:41:24.914 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-12T20:41:24.956 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:41:24.957 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:41:24.957 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:41:24.962 INFO:tasks.workunit.client.0.trial099.stdout:create new divergent objects 2026-02-12T20:41:24.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-12T20:41:24.963 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-12T20:41:24.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:41:24.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:41:24.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-12T20:41:24.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-12T20:41:24.964 INFO:tasks.workunit.client.0.trial099.stdout:writing divergent objects 2026-02-12T20:41:24.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-12T20:41:24.965 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-12T20:41:24.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-12T20:41:24.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-12T20:41:24.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.2z99u29wCO 2026-02-12T20:41:24.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-12T20:41:24.966 INFO:tasks.workunit.client.0.trial099.stdout:remove divergent objects 2026-02-12T20:41:24.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.2z99u29wCO 2026-02-12T20:41:24.967 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-12T20:41:24.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-12T20:41:24.967 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-12T20:41:24.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-12T20:41:24.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-12T20:41:24.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-12T20:41:24.969 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-12T20:41:24.969 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-12T20:41:24.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-12T20:41:24.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-12T20:41:34.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-12T20:41:34.999 INFO:tasks.workunit.client.0.trial099.stderr:rados: no process found 2026-02-12T20:41:34.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-12T20:41:35.000 INFO:tasks.workunit.client.0.trial099.stdout:killing all the osds 2026-02-12T20:41:35.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:41:35.219 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:41:35.219 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-12T20:41:11.145306+0000 29'106 29:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:29:14.098169+0000 0 0 2026-02-12T20:41:35.219 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:41:35.220 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:41:35.220 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:41:35.226 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-12T20:41:35.227 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:41:35.227 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:41:35.227 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:41:35.227 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:41:35.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:41:35.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:41:35.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-12T20:41:35.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-12T20:41:35.614 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:41:35.622 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-12T20:41:35.623 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-12T20:41:35.903 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:41:35.911 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-12T20:41:35.911 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-12T20:41:36.189 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:41:36.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:36.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-12T20:41:36.477 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already out. 2026-02-12T20:41:36.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:36.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-12T20:41:36.766 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already out. 2026-02-12T20:41:36.773 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-12T20:41:36.774 INFO:tasks.workunit.client.0.trial099.stdout:bringing up non_divergent 0 2 2026-02-12T20:41:36.774 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:41:36.989 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:41:36.989 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-12T20:41:11.145306+0000 29'106 29:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 periodic scrub scheduled @ 2026-02-14T03:29:14.098169+0000 0 0 2026-02-12T20:41:36.989 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:41:36.990 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:41:36.990 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:41:36.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:36.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-12T20:41:36.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:41:36.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:41:36.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:41:36.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:41:37.000 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:41:37.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:41:37.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:41:37.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:41:37.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:41:37.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:41:37.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:41:37.002 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:41:37.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:41:37.003 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-12T20:41:37.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:41:37.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:41:37.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:41:37.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:41:37.018 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:37.026+0000 7fbc84a34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:37.019 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:37.028+0000 7fbc84a34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:37.020 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:37.029+0000 7fbc84a34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:37.202 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:37.211+0000 7fbc84a34780 -1 Falling back to public interface 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:41:37.232 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:41:37.233 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:37.233 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:41:37.465 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:41:37.570 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:37.579+0000 7fbc84a34780 -1 osd.0 29 log_to_monitors true 2026-02-12T20:41:38.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:41:38.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:38.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:41:38.467 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:41:38.468 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:38.468 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:41:38.697 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/2669774562,v1:127.0.0.1:6801/2669774562] [v2:127.0.0.1:6802/2669774562,v1:127.0.0.1:6803/2669774562] exists,up 46fb6b4a-ed00-419c-8eab-b8399a4943ba 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:41:38.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:41:38.702 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:41:38.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:41:38.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:41:38.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:41:38.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:41:38.704 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:41:38.705 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:41:38.705 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-12T20:41:38.705 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:41:38.705 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:41:38.705 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:41:38.705 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:41:38.720 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:38.729+0000 7fe7af40f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:38.722 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:38.730+0000 7fe7af40f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:38.723 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:38.731+0000 7fe7af40f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:41:38.885 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:38.893+0000 7fe7af40f780 -1 Falling back to public interface 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:41:38.931 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:41:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:41:39.165 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:41:39.198 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:41:39.207+0000 7fe7af40f780 -1 osd.2 29 log_to_monitors true 2026-02-12T20:41:40.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:41:40.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:41:40.167 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:41:40.167 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:41:40.168 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:41:40.168 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:41:40.395 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/4281661263,v1:127.0.0.1:6811/4281661263] [v2:127.0.0.1:6812/4281661263,v1:127.0.0.1:6813/4281661263] exists,up 7f0a1efd-064c-441f-852a-5a313dff7318 2026-02-12T20:41:40.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:41:40.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:41:40.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:41:40.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:40.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-12T20:41:40.646 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already in. 2026-02-12T20:41:40.653 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:41:40.653 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-12T20:41:40.950 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already in. 2026-02-12T20:41:40.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:41:40.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-12T20:41:40.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:41:40.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:41:40.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:41:40.959 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:41:40.960 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:41:40.960 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:41:40.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:41:40.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:41:40.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:41:41.011 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:41:41.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:41:41.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:41:41.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:41:41.012 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:41:41.012 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:41:41.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:41:41.240 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:41:41.240 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:41:41.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:41:41.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:41.241 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:41:41.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-12T20:41:41.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-12T20:41:41.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822659' 2026-02-12T20:41:41.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:41.308 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:41:41.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:41:41.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:41:41.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:41:41.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:41:41.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:41:41.358 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:41:41.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-12T20:41:41.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-12T20:41:41.427 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822659 2-167503724547' 2026-02-12T20:41:41.427 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:41.427 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822659 2026-02-12T20:41:41.427 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:41.427 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:41:41.428 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822659 2026-02-12T20:41:41.428 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:41.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-12T20:41:41.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822659' 2026-02-12T20:41:41.429 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 154618822659 2026-02-12T20:41:41.430 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:41.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822659 2026-02-12T20:41:41.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:41:42.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:41:42.665 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:41:42.896 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822659 2026-02-12T20:41:42.896 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:41:42.896 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724547 2026-02-12T20:41:42.897 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:41:42.897 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:41:42.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724547 2026-02-12T20:41:42.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:41:42.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724547 2026-02-12T20:41:42.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724547' 2026-02-12T20:41:42.899 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 167503724547 2026-02-12T20:41:42.900 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:41:43.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-12T20:41:43.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:41:43.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:43.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:43.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:41:43.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:43.445 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:43.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:43.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:43.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:43.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:43.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:43.670 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:43.670 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:43.670 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:43.671 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:43.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:43.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:41:43.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:41:43.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:41:43.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:43.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:41:44.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:41:44.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:44.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:44.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:44.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:44.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:44.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:44.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:44.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:44.319 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:44.319 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:44.319 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:44.642 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:44.642 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:41:44.643 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:41:44.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:41:44.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:41:44.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:41:44.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:44.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:41:45.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:41:45.159 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:45.160 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:45.160 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:45.160 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:45.160 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:45.160 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:45.160 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:45.394 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:45.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:45.395 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:45.395 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:45.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:45.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:41:45.715 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:41:46.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:41:46.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:41:46.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:41:46.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:46.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:41:46.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:41:46.435 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:46.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:46.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:46.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:46.436 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:46.437 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:46.437 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:46.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:46.666 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:46.666 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:46.666 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:46.984 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:46.984 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:41:46.984 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:41:46.984 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:41:46.984 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:41:46.985 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:41:46.985 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:41:46.985 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:41:46.985 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:41:47.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:41:47.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:41:47.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:41:47.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:47.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:41:48.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:41:48.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:48.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:48.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:48.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:48.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:48.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:48.121 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:48.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:48.350 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:48.351 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:48.351 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:41:48.674 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:41:48.675 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:41:48.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:41:48.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:41:48.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:41:48.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:48.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:41:50.599 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:41:50.599 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:50.600 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:50.600 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:50.600 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:50.600 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:50.600 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:50.601 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:50.827 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:50.827 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:50.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:50.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:51.147 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:41:51.148 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:41:51.466 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:41:51.466 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:41:51.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:41:51.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:51.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:41:54.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:41:54.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:41:54.668 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:41:54.668 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:41:54.668 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:41:54.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:41:54.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:41:54.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:41:54.897 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:41:54.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:41:54.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:41:54.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:41:55.212 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:41:55.529 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:41:55.529 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:41:55.529 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:41:55.529 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:41:55.529 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:42:01.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:01.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:01.931 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:01.931 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:01.931 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:01.931 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:01.932 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:01.932 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:02.165 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:02.166 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:02.166 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:02.166 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:02.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:02.485 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:02.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:02.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:02.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:42:02.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:02.802 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:42:10.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:10.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:10.103 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:10.103 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:10.104 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:10.104 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:10.104 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:10.104 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:10.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:10.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:10.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:10.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:10.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:10.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:10.701 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:11.021 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:11.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:11.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:42:11.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:42:11.336 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "aff85d3e-b3ee-4cc1-b840-bcb2dbc08cc0", 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:42:11.345460+0000", 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:42:11.337 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:42:11.338 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:42:11.339 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: "count": 32 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.340 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.341 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.342 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.343 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.344 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.345 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.346 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.347 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:41:02.565181Z", 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:41:02.565181Z", 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:42:11.348 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:42:11.349 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.350 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:42:11.351 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:41:02:565177+0000", 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 47, 2026-02-12T20:42:11.352 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:41:02.600943+0000", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:42:06.947349+0000", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:41:39.354771+0000", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:41:40.893643+0000", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:42:11.353 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 9, 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:42:11.354 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:41:11.006542+0000", 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 1, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool", 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 0, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:42:11.355 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "on", 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 32, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 32, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 32, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 32, 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:42:11.356 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "46", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "46", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "selfmanaged", 2026-02-12T20:42:11.357 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 0, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 0, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [], 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:42:11.358 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "", 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:42:11.359 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 0, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {}, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "read_balance": { 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "score_type": "Fair distribution", 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "score_acting": 2.9900000095367432, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "score_stable": 2.9900000095367432, 2026-02-12T20:42:11.360 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_score": 0.67000001668930054, 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_acting": 2, 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_stable": 2, 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity_weighted": 1, 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity": 1, 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity_weighted": 1 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "46fb6b4a-ed00-419c-8eab-b8399a4943ba", 2026-02-12T20:42:11.361 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 5, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 29, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 36, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 46, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 30, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.362 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.363 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.364 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.365 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.366 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/2669774562", 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/2669774562", 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2669774562", 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2669774562", 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "bfb77b03-7b3c-4840-9f05-34cc73b7a065", 2026-02-12T20:42:11.367 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 9, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 21, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 31, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.368 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.369 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.370 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.371 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:11.372 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/279077078", 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/279077078", 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/279077078", 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/279077078", 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "7f0a1efd-064c-441f-852a-5a313dff7318", 2026-02-12T20:42:11.373 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 13, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 29, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 39, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 32, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:42:11.374 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:42:11.375 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.376 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.377 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/4281661263", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/4281661263", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4281661263", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4281661263", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.378 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:41:35.558097+0000", 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:41:05.134833+0000", 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:41:35.846938+0000", 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:42:11.379 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:41:36.134175+0000", 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:41:09.608652+0000", 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:42:11.380 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:42:11.381 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/2669774562,v1:127.0.0.1:6803/2669774562]", 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:42:11.382 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:11.383 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:41:03.311818Z", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/2669774562,v1:127.0.0.1:6801/2669774562]", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2669774562,v1:127.0.0.1:6807/2669774562]", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2669774562,v1:127.0.0.1:6805/2669774562]", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:42:11.384 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/279077078,v1:127.0.0.1:6813/279077078]", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:42:11.385 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:11.386 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:41:05.231266Z", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/279077078,v1:127.0.0.1:6811/279077078]", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/279077078,v1:127.0.0.1:6817/279077078]", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/279077078,v1:127.0.0.1:6815/279077078]", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:42:11.387 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/4281661263,v1:127.0.0.1:6813/4281661263]", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:42:11.388 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:41:07.839043Z", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:42:11.389 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/4281661263,v1:127.0.0.1:6811/4281661263]", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4281661263,v1:127.0.0.1:6817/4281661263]", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4281661263,v1:127.0.0.1:6815/4281661263]", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:42:11.390 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 0, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [] 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 36 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 39 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 47, 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:42:11.391 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:42:11.392 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:42:11.393 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stderr:report 3556240109 2026-02-12T20:42:11.394 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:11.395 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:11.396 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:42:11.397 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:42:11.398 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:42:11.399 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 0, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:41:02:600782+0000", 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:42:11.400 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.401 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 32, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 32, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51200, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 100, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 100, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:42:11.402 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 512, 2026-02-12T20:42:11.403 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 512, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "up": 64, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 64, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 34, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83968, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2184, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 32, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81695, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488832, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036563968, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2236416, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 464033, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 33222, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83656250 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.404 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 34, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83968, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2184, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 32, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81695, 2026-02-12T20:42:11.405 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488832, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036563968, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2236416, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 464033, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 33222, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83656250 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.406 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 32, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51200, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 100, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 100, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:42:11.407 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1220608, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 153552, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 512, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 512, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "up": 64, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 64, 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.408 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 154618822665 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 38654705676 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 167503724553 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "num": 31 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded+wait", 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "num": 1 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:42:11.409 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 32, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 32, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 32, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 3, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:42:08.795832+0000", 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "services": { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "osd": { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "daemons": { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "summary": "", 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "0": { 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:42:11.410 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "2": { 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 35, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 219, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 309, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:42:11.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:42:11.412 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-12T20:42:11.412 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-12T20:42:11.412 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-12T20:42:11.412 INFO:tasks.workunit.client.0.trial099.stdout:writing non-divergent object existing_4 2026-02-12T20:42:11.412 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.563 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-12T20:42:06.955595+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:11.564 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:11.565 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:11.565 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:11.570 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.2z99u29wCO 2026-02-12T20:42:11.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:42:11.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-12T20:42:11.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:42:11.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:42:11.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:42:11.590 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:42:11.591 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:42:11.591 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:42:11.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:42:11.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:42:11.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:42:11.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:42:11.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:42:11.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:42:11.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:42:11.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:42:11.645 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:42:11.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:42:11.875 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:42:11.875 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:42:11.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:42:11.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:42:11.876 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:42:11.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822667 2026-02-12T20:42:11.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822667 2026-02-12T20:42:11.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822667' 2026-02-12T20:42:11.942 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:42:11.943 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:42:11.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:42:11.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:42:11.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:42:11.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:42:11.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:42:11.993 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:42:12.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724555 2026-02-12T20:42:12.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724555 2026-02-12T20:42:12.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822667 2-167503724555' 2026-02-12T20:42:12.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:42:12.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822667 2026-02-12T20:42:12.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:42:12.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:42:12.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822667 2026-02-12T20:42:12.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:42:12.066 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822667 2026-02-12T20:42:12.066 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822667' 2026-02-12T20:42:12.066 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 154618822667 2026-02-12T20:42:12.066 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:42:12.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822665 -lt 154618822667 2026-02-12T20:42:12.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:42:13.295 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:42:13.296 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:42:13.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822668 -lt 154618822667 2026-02-12T20:42:13.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:42:13.527 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724555 2026-02-12T20:42:13.527 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:42:13.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:42:13.529 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724555 2026-02-12T20:42:13.529 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:42:13.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724555 2026-02-12T20:42:13.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724555' 2026-02-12T20:42:13.530 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 167503724555 2026-02-12T20:42:13.531 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:42:13.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724555 -lt 167503724555 2026-02-12T20:42:13.764 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:42:13.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:13.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:14.078 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:14.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:14.307 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:14.308 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:14.308 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:14.308 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:14.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:14.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:42:14.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:42:14.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:42:14.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:14.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:42:14.747 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:14.747 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:14.748 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:14.748 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:14.748 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:14.748 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:14.749 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:14.749 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:14.981 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:14.982 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:14.982 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:14.982 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:15.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:15.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:15.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:15.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:15.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:15.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:15.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:15.303 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:15.303 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:15.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:15.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:15.637 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:42:15.637 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:15.637 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:42:15.837 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:15.837 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:15.838 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:15.838 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:15.838 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:15.838 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:15.839 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:15.839 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:16.071 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:16.071 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:16.071 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:16.072 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:16.390 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:16.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:16.703 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:16.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:42:16.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:16.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:42:17.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:17.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:17.105 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:17.105 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:17.106 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:17.106 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:17.106 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:17.106 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:17.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:17.334 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:17.335 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:17.335 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:17.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:17.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:17.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:17.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:17.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:17.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:17.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:17.651 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:17.651 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:17.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:17.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:17.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:42:17.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:17.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:42:18.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:18.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:18.766 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:18.766 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:18.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:18.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:18.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:18.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:19.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:19.002 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:19.002 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:19.002 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:19.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:19.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:19.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:19.319 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:19.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:19.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:19.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:19.320 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:19.320 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:19.635 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:19.635 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:19.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:42:19.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:19.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:42:21.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:21.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:21.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:21.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:21.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:21.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:21.237 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:21.237 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:21.466 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:21.467 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:21.467 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:21.467 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:21.802 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:21.802 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:21.802 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:21.803 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:21.803 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:21.803 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:21.803 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:21.803 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:21.803 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:22.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:22.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:22.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:42:22.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:22.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:42:25.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:25.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:25.344 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:25.344 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:25.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:25.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:25.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:25.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:25.575 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:25.576 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:25.577 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:25.577 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:25.895 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:25.896 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:25.896 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:26.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:26.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:26.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:42:26.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:26.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:42:32.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:32.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:32.618 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:32.618 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:32.618 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:32.618 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:32.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:32.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:32.847 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:32.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:32.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:32.848 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:33.166 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:33.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:33.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:33.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:42:33.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:42:33.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:42:40.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:42:40.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:42:40.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:42:40.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:42:40.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:42:40.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:42:40.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:42:40.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:42:41.018 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:42:41.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:42:41.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:42:41.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:42:41.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-12T20:42:41.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:42:41.340 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:42:41.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:42:41.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:42:41.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:42:41.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:42:41.972 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:42:41.972 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "aff85d3e-b3ee-4cc1-b840-bcb2dbc08cc0", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:42:41.981228+0000", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:42:41.973 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.974 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: "count": 32 2026-02-12T20:42:41.975 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.976 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.977 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.978 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.979 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.980 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.981 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.982 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.983 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:41:02.565181Z", 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:41:02.565181Z", 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:42:41.984 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:42:41.985 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:42:41.986 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:42:41.987 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:41:02:565177+0000", 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 47, 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:41:02.600943+0000", 2026-02-12T20:42:41.988 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:42:06.947349+0000", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:41:39.354771+0000", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:41:40.893643+0000", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:42:41.989 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 9, 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:42:41.990 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:41:11.006542+0000", 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 1, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool", 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 0, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:42:41.991 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "on", 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 32, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 32, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 32, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 32, 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:42:41.992 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "46", 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "46", 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "selfmanaged", 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 0, 2026-02-12T20:42:41.993 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 0, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [], 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:42:41.994 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "", 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:42:41.995 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 0, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {}, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "read_balance": { 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "score_type": "Fair distribution", 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "score_acting": 2.9900000095367432, 2026-02-12T20:42:41.996 INFO:tasks.workunit.client.0.trial099.stdout: "score_stable": 2.9900000095367432, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_score": 0.67000001668930054, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_acting": 2, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "raw_score_stable": 2, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity_weighted": 1, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity": 1, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "average_primary_affinity_weighted": 1 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:41.997 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "46fb6b4a-ed00-419c-8eab-b8399a4943ba", 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 5, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 29, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 36, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 46, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 30, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:41.998 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:42:41.999 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.000 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.001 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2669774562 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.002 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/2669774562", 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/2669774562", 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2669774562", 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2669774562", 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:42.003 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "bfb77b03-7b3c-4840-9f05-34cc73b7a065", 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 9, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 21, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 31, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.004 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:42:42.005 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.006 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.007 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:42:42.008 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 279077078 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/279077078", 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/279077078", 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/279077078", 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/279077078", 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.009 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "7f0a1efd-064c-441f-852a-5a313dff7318", 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 13, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 29, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 39, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 32, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:42:42.010 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.011 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.012 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.013 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 4281661263 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/4281661263", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/4281661263", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4281661263", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4281661263", 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:42:42.014 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:41:35.558097+0000", 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:41:05.134833+0000", 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.015 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:41:35.846938+0000", 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:41:36.134175+0000", 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:42:42.016 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:41:09.608652+0000", 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:42:42.017 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.018 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/2669774562,v1:127.0.0.1:6803/2669774562]", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:42:42.019 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:41:03.311818Z", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/2669774562,v1:127.0.0.1:6801/2669774562]", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:42:42.020 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2669774562,v1:127.0.0.1:6807/2669774562]", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2669774562,v1:127.0.0.1:6805/2669774562]", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.021 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/279077078,v1:127.0.0.1:6813/279077078]", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:42:42.022 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:41:05.231266Z", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/279077078,v1:127.0.0.1:6811/279077078]", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/279077078,v1:127.0.0.1:6817/279077078]", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/279077078,v1:127.0.0.1:6815/279077078]", 2026-02-12T20:42:42.023 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/4281661263,v1:127.0.0.1:6813/4281661263]", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:42:42.024 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:42:42.025 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:41:07.839043Z", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/4281661263,v1:127.0.0.1:6811/4281661263]", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4281661263,v1:127.0.0.1:6817/4281661263]", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4281661263,v1:127.0.0.1:6815/4281661263]", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:42:42.026 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 0, 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [] 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 36 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 39 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.027 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 47, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.028 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.029 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:42:42.030 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stderr:report 1359561197 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:42:42.031 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:42.032 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:42.033 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:42:42.034 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.035 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 0, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.036 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:41:02:600782+0000", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:42:42.037 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 32, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 32, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51688, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:42:42.038 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:42:42.039 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 513, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 513, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "up": 64, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 64, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 65, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83984, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2200, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 33, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81694, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488816, 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:42:42.040 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036547584, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2252800, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 470773, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 34526, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83654946 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.041 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 65, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83984, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2200, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 33, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81694, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488816, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036547584, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2252800, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 470773, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 34526, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83654946 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:42:42.042 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 32, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 51688, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 100, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 300, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 100, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 100, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:42:42.043 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:42:42.044 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1220608, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 154528, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 513, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 513, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "up": 64, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 64, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 154618822673 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 38654705676 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 167503724561 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:42:42.045 INFO:tasks.workunit.client.0.trial099.stdout: "num": 32 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 32, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 32, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 32, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:42:42.046 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 5, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:42:40.801198+0000", 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "services": {} 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 50, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 284, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 389, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery 2026-02-12T20:42:42.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:42.206 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:42.206 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.206 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.206 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.206 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.206 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 47:157 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 47:157 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.207 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:42.208 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:42.213 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:42:42.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-12T20:42:42.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok set_recovery_delay 100000 2026-02-12T20:42:42.260 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:42:42.264 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-12T20:42:42.264 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-12T20:42:42.264 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-12T20:42:42.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok set_recovery_delay 100000 2026-02-12T20:42:42.312 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:42:42.316 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-12T20:42:42.317 INFO:tasks.workunit.client.0.trial099.stdout:revive divergent 1 2026-02-12T20:42:42.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:42.536 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:42.536 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.536 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.537 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 47:157 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 47:157 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.538 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.539 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.540 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:42.540 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:42.540 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:42.540 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:42.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-12T20:42:42.868 INFO:tasks.workunit.client.0.trial099.stderr:noup is set 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:42:42.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:42:42.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:42:42.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:42:42.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:42:42.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:42:42.898 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:42.907+0000 7f9e27e23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:42:42.899 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:42.908+0000 7f9e27e23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:42:42.900 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:42.909+0000 7f9e27e23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:42:43.034 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:43.043+0000 7f9e27e23780 -1 Falling back to public interface 2026-02-12T20:42:43.116 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-12T20:42:43.116 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-12T20:42:43.319 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:43.327+0000 7f9e27e23780 -1 osd.1 29 log_to_monitors true 2026-02-12T20:42:48.117 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery divergent 2026-02-12T20:42:48.117 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-12T20:42:48.117 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:48.337 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.338 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 47:157 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 47:157 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.339 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.340 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 47:156 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:48.341 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:48.341 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:48.341 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:48.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-12T20:42:48.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:42:48.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:42:48.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:42:48.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:42:48.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:42:48.346 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:42:48.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-12T20:42:48.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok set_recovery_delay 100000 2026-02-12T20:42:48.391 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:42:48.394 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-12T20:42:48.712 INFO:tasks.workunit.client.0.trial099.stderr:noup is unset 2026-02-12T20:42:48.722 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-12T20:42:48.722 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:42:48.723 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:42:48.723 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:42:48.723 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:42:48.723 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:42:48.723 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:42:48.724 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:42:48.724 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:42:48.724 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:42:48.951 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 36 up_thru 46 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6800/2669774562,v1:127.0.0.1:6801/2669774562] [v2:127.0.0.1:6802/2669774562,v1:127.0.0.1:6803/2669774562] exists,up 46fb6b4a-ed00-419c-8eab-b8399a4943ba 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:42:48.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:42:48.954 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:42:48.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:42:48.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:42:48.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:42:49.178 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2552150171,v1:127.0.0.1:6819/2552150171] [v2:127.0.0.1:6820/2552150171,v1:127.0.0.1:6821/2552150171] exists,up bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:42:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:42:49.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:42:49.181 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:42:49.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:42:49.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:42:49.411 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/4281661263,v1:127.0.0.1:6811/4281661263] [v2:127.0.0.1:6812/4281661263,v1:127.0.0.1:6813/4281661263] exists,up 7f0a1efd-064c-441f-852a-5a313dff7318 2026-02-12T20:42:49.412 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:42:49.412 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:42:49.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:42:49.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:49.632 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:49.632 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.632 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.632 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:09.679393+0000 0 0 2026-02-12T20:42:49.632 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:15.784382+0000 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:40.908434+0000 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.633 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:20.792145+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:33.832164+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:12.690375+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:32.851325+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:38.867661+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:14.736106+0000 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.634 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:18.793158+0000 0 0 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:22.829225+0000 0 0 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:39.881367+0000 0 0 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:49.635 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:49.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-12T20:42:49.640 INFO:tasks.workunit.client.0.trial099.stdout:wait for peering 2026-02-12T20:42:49.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:09.679393+0000 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:15.784382+0000 0 0 2026-02-12T20:42:49.859 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:40.908434+0000 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:20.792145+0000 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.860 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:33.832164+0000 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:12.690375+0000 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:32.851325+0000 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:38.867661+0000 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:14.736106+0000 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:18.793158+0000 0 0 2026-02-12T20:42:49.861 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:22.829225+0000 0 0 2026-02-12T20:42:49.862 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:39.881367+0000 0 0 2026-02-12T20:42:49.862 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:49.862 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:49.862 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:49.866 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.gZYONuQv1s 2026-02-12T20:42:49.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.gZYONuQv1s 2026-02-12T20:42:49.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.2z99u29wCO 2026-02-12T20:42:49.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-12T20:42:49.889 INFO:tasks.workunit.client.0.trial099.stdout:killing divergent 1 2026-02-12T20:42:49.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:50.106 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:50.106 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.106 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.106 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:09.679393+0000 0 0 2026-02-12T20:42:50.106 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:15.784382+0000 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:40.908434+0000 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.107 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:20.792145+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:33.832164+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:12.690375+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:32.851325+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:38.867661+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:14.736106+0000 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.108 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:18.793158+0000 0 0 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:22.829225+0000 0 0 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:39.881367+0000 0 0 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:50.109 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:50.112 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-12T20:42:50.113 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:42:50.113 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:42:50.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:42:50.113 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:42:50.114 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:42:50.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:42:50.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.24351.out 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.24351.out 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-12T20:42:50.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.24351.out 2026-02-12T20:42:50.310 INFO:tasks.workunit.client.0.trial099.stderr:Exporting 1.0 info 1.0( v 29'100 (29'90,29'100] local-lis/les=52/53 n=3 ec=21/21 lis/c=52/52 les/c/f=53/53/0 sis=52) 2026-02-12T20:42:50.310 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-12T20:42:50.310 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-12T20:42:50.310 INFO:tasks.workunit.client.0.trial099.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-12T20:42:50.310 INFO:tasks.workunit.client.0.trial099.stderr:Export successful 2026-02-12T20:42:50.311 INFO:tasks.workunit.client.0.trial099.stdout: marking collection for removal 2026-02-12T20:42:50.311 INFO:tasks.workunit.client.0.trial099.stdout:setting '_remove' omap key 2026-02-12T20:42:50.311 INFO:tasks.workunit.client.0.trial099.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-12T20:42:50.311 INFO:tasks.workunit.client.0.trial099.stderr:Remove successful 2026-02-12T20:42:50.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.24351.out 2026-02-12T20:42:50.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:42:50.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:42:50.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-12T20:42:50.351 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:42:50.352 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-12T20:42:50.352 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.24351.out 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:get_pg_num_history pg_num_history pg_num_history(e54 pg_nums {1={21=1,46=32}} deleted_pools ) 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:Importing pgid 1.0 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:snapset 0={} 2026-02-12T20:42:50.446 INFO:tasks.workunit.client.0.trial099.stdout:write_pg epoch 53 info 1.0( v 29'100 (29'90,29'100] local-lis/les=52/53 n=3 ec=21/21 lis/c=52/52 les/c/f=53/53/0 sis=52) 2026-02-12T20:42:50.447 INFO:tasks.workunit.client.0.trial099.stdout:Import successful 2026-02-12T20:42:50.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-12T20:42:50.484 INFO:tasks.workunit.client.0.trial099.stdout:reviving divergent 1 2026-02-12T20:42:50.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957444+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957383+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955972+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:09.679393+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957784+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957907+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957688+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956091+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:15.784382+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958207+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958263+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958063+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957492+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:40.908434+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957773+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957862+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957606+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957392+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956270+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:20.792145+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:20.998928+0000 29'100 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:08.674144+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957403+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-12T20:42:06.958254+0000 47'101 50:162 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.958589+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956533+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:33.832164+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.955934+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:12.690375+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956428+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:32.851325+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956502+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:38.867661+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956048+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:14.736106+0000 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957320+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.705 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957309+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957717+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.957653+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956148+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:18.793158+0000 0 0 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956361+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:22.829225+0000 0 0 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:42:06.956762+0000 29'100 50:161 [0,2] 0 [0,2] 0 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 user requested scrub scheduled @ 2026-02-12T20:43:39.881367+0000 0 0 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:42:50.706 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:42:50.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:42:50.713 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:42:50.714 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:42:50.715 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:42:50.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:42:50.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:42:50.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:42:50.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:42:50.733 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:50.741+0000 7f2f68a4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:42:50.734 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:50.742+0000 7f2f68a4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:42:50.735 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:50.743+0000 7f2f68a4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:42:50.891 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:50.898+0000 7f2f68a4c780 -1 Falling back to public interface 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:42:50.954 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:42:50.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:42:50.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:42:51.187 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:42:51.194+0000 7f2f68a4c780 -1 osd.1 54 log_to_monitors true 2026-02-12T20:42:51.195 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/2552150171,v1:127.0.0.1:6819/2552150171] [v2:127.0.0.1:6820/2552150171,v1:127.0.0.1:6821/2552150171] exists,up bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:42:51.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:42:51.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:42:51.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:42:51.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:42:52.428 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:42:52.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:42:52.429 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:42:52.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:42:52.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:42:52.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:42:52.673 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 57 up_thru 57 down_at 56 last_clean_interval [52,54) [v2:127.0.0.1:6818/995509832,v1:127.0.0.1:6819/995509832] [v2:127.0.0.1:6820/995509832,v1:127.0.0.1:6821/995509832] exists,up bfb77b03-7b3c-4840-9f05-34cc73b7a065 2026-02-12T20:42:52.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:42:52.674 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:42:52.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:42:52.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-12T20:43:12.675 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-12T20:43:12.675 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:43:12.675 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:43:12.676 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:43:12.676 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:12.676 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:12.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:43:12.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-12T20:43:12.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok dump_ops_in_flight 2026-02-12T20:43:12.721 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:43:12.721 INFO:tasks.workunit.client.0.trial099.stdout: "ops": [], 2026-02-12T20:43:12.722 INFO:tasks.workunit.client.0.trial099.stdout: "num_ops": 0 2026-02-12T20:43:12.722 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:43:12.725 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-12T20:43:12.725 INFO:tasks.workunit.client.0.trial099.stdout:allowing recovery 2026-02-12T20:43:12.725 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:43:12.945 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:43:12.945 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.961254+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.945 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:06.962884+0000 29'100 71:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.945 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-12T20:43:04.475238+0000 29'100 69:169 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:43:04.475210+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T00:34:56.169403+0000 4 0 2026-02-12T20:43:12.945 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962541+0000 29'100 71:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.945 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-12T20:43:08.975999+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:08.975969+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T00:04:36.695785+0000 3 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962638+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:10.960450+0000 29'100 71:207 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-12T20:43:06.324944+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.962379+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-12T20:43:06.962885+0000 54'101 71:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962834+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:51.612246+0000 29'100 71:191 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962342+0000 29'100 71:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-12T20:43:09.976542+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:09.976512+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T03:19:55.027126+0000 1 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-12T20:42:51.612653+0000 29'100 71:192 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962738+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:42:52.229518+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.946 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:51.612234+0000 29'100 71:191 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-12T20:42:59.216917+0000 29'100 71:200 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-12T20:42:59.216870+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-13T22:38:48.211307+0000 3 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962902+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 active+clean 2026-02-12T20:43:06.962723+0000 47'101 71:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.962371+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-12T20:42:55.198863+0000 29'100 71:200 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-12T20:42:55.198829+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 periodic scrub scheduled @ 2026-02-14T01:49:53.918266+0000 3 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-12T20:43:03.432942+0000 29'100 69:169 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:43:03.432914+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T04:43:46.508245+0000 3 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-12T20:43:03.876736+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:03.876703+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T01:48:48.182382+0000 1 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962513+0000 29'100 71:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:42:51.611617+0000 29'100 71:192 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962160+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.947 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:06.962710+0000 29'100 71:181 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.961592+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:10.960450+0000 29'100 71:199 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-12T20:43:01.374844+0000 29'100 69:169 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:43:01.374811+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T01:17:16.673997+0000 2 0 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-12T20:43:05.877338+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:05.877307+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-13T21:55:34.498099+0000 4 0 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962280+0000 29'100 71:190 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:43:12.948 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:12.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-12T20:43:12.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-12T20:43:13.018 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:43:13.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-12T20:43:13.025 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-12T20:43:13.087 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:43:13.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-12T20:43:13.091 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-12T20:43:13.155 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:43:13.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-12T20:43:13.161 INFO:tasks.workunit.client.0.trial099.stdout:reading divergent objects 2026-02-12T20:43:13.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-12T20:43:13.378 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.961254+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:06.962884+0000 29'100 71:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-12T20:43:04.475238+0000 29'100 69:169 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:43:04.475210+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T00:34:56.169403+0000 4 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962541+0000 29'100 71:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-12T20:43:08.975999+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:08.975969+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T00:04:36.695785+0000 3 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962638+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.8 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:10.960450+0000 29'100 71:207 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-12T20:43:06.324944+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.962379+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.379 INFO:tasks.workunit.client.0.trial099.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-12T20:43:06.962885+0000 54'101 71:183 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962834+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:51.612246+0000 29'100 71:191 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962342+0000 29'100 71:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-12T20:43:09.976542+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:09.976512+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T03:19:55.027126+0000 1 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-12T20:42:51.612653+0000 29'100 71:192 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962738+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:42:52.229518+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:51.612234+0000 29'100 71:191 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-12T20:42:59.216917+0000 29'100 71:200 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-12T20:42:59.216870+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-13T22:38:48.211307+0000 3 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962902+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.380 INFO:tasks.workunit.client.0.trial099.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 active+clean 2026-02-12T20:43:06.962723+0000 47'101 71:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.962371+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-12T20:42:55.198863+0000 29'100 71:200 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-12T20:42:55.198829+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 periodic scrub scheduled @ 2026-02-14T01:49:53.918266+0000 3 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-12T20:43:03.432942+0000 29'100 69:169 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:43:03.432914+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T04:43:46.508245+0000 3 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-12T20:43:03.876736+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:03.876703+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T01:48:48.182382+0000 1 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962513+0000 29'100 71:189 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:42:51.611617+0000 29'100 71:192 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:42:56.962160+0000 29'100 69:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:06.962710+0000 29'100 71:181 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-12T20:43:00.961592+0000 29'100 71:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:10.960450+0000 29'100 71:199 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.381 INFO:tasks.workunit.client.0.trial099.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-12T20:43:01.374844+0000 29'100 69:169 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-12T20:43:01.374811+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-14T01:17:16.673997+0000 2 0 2026-02-12T20:43:13.382 INFO:tasks.workunit.client.0.trial099.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-12T20:43:05.877338+0000 29'100 71:207 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-12T20:43:05.877307+0000 0'0 2026-02-12T20:41:11.034375+0000 0 1 periodic scrub scheduled @ 2026-02-13T21:55:34.498099+0000 4 0 2026-02-12T20:43:13.382 INFO:tasks.workunit.client.0.trial099.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-12T20:43:00.962280+0000 29'100 71:190 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-12T20:41:11.034375+0000 0'0 2026-02-12T20:41:11.034375+0000 0 0 queued for scrub 0 0 2026-02-12T20:43:13.382 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:43:13.382 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:43:13.382 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:13.386 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-12T20:43:13.387 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-12T20:43:13.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:43:13.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-12T20:43:13.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:43:13.408 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-12T20:43:13.427 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:43:13.427 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-12T20:43:13.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:43:13.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-12T20:43:13.463 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-12T20:43:13.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:43:13.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-12T20:43:13.482 INFO:tasks.workunit.client.0.trial099.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-12T20:43:13.483 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-12T20:43:13.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-12T20:43:13.502 INFO:tasks.workunit.client.0.trial099.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-12T20:43:13.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-12T20:43:13.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-12T20:43:13.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:43:13.512 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-12T20:41:24.998004+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:43:13.512 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-12T20:41:24.998004+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: more recent entry found: 47'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4654.0:1 2026-02-12T20:42:11.597504+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4534.0:1 2026-02-12T20:41:24.991095+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4534.0:1 2026-02-12T20:41:24.991095+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-12T20:43:13.513 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e02762640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2026-02-12T20:41:24.994013+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 20 _merge_object_divergent_entries: keeping 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2026-02-12T20:41:24.994013+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'104 (29'2) modify 1:97db2a0f:::existing_2:head by client.4540.0:1 2026-02-12T20:41:24.994013+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-12T20:43:13.514 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e04f67640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'89 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4543.0:1 2026-02-12T20:41:24.996250+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4543.0:1 2026-02-12T20:41:24.996250+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4543.0:1 2026-02-12T20:41:24.996250+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-12T20:43:13.515 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.309+0000 7f9e08f6f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'84 2026-02-12T20:43:13.516 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4538.0:1 2026-02-12T20:41:24.993181+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:43:13.516 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 20 _merge_object_divergent_entries: keeping 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4538.0:1 2026-02-12T20:41:24.993181+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:43:13.518 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:43:13.518 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-12T20:43:13.518 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-12T20:43:13.518 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:43:13.518 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'103 (29'1) modify 1:d858c035:::existing_1:head by client.4538.0:1 2026-02-12T20:41:24.993181+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-12T20:41:24.991335+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 20 _merge_object_divergent_entries: keeping 29'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4533.0:1 2026-02-12T20:41:24.991335+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'102 last_divergent_update: 29'102 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-12T20:43:13.519 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:42:49.310+0000 7f9e03f65640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-12T20:43:13.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-12T20:43:13.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:43:13.525 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-12T20:43:13.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:43:13.533 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-12T20:43:13.533 INFO:tasks.workunit.client.0.trial099.stdout:success 2026-02-12T20:43:13.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.24351.out 2026-02-12T20:43:13.534 INFO:tasks.workunit.client.0.trial099.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.24351.out': No such file or directory 2026-02-12T20:43:13.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-12T20:43:13.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-12T20:43:13.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-12T20:43:13.811 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' does not exist 2026-02-12T20:43:13.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-12T20:43:13.821 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:43:13.821 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:43:13.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:43:13.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:43:13.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:43:19.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:43:19.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-12T20:43:19.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:43:19.136 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:43:19.136 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:43:19.136 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:43:19.136 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:43:19.136 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:43:19.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:43:19.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:43:19.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:43:19.142 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:43:19.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:43:19.143 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:43:19.143 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:43:19.144 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:43:19.144 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:43:19.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:43:19.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:43:19.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:43:19.145 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:43:19.146 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:43:19.147 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:43:19.147 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:43:19.168 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:43:19.168 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.168 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.168 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:43:19.169 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:43:19.170 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:43:19.170 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:43:19.170 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:43:19.170 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:43:19.170 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:43:19.172 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:43:19.172 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:43:19.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:43:19.173 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:43:19.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:43:19.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:43:19.174 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:43:19.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:43:19.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:43:19.175 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:43:19.176 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:43:19.176 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:43:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:43:19.177 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:43:19.178 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:43:19.178 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.178 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:43:19.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:43:19.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:43:19.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-12T20:43:19.180 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:43:19.181 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.181 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.24351 2026-02-12T20:43:19.182 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:43:19.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-12T20:43:19.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:43:19.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-12T20:43:19.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-12T20:43:19.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-12T20:43:19.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-12T20:43:19.183 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-12T20:43:19.183 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:43:19.184 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:19.185 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.Ln4GZ4uqRh bs=512 count=1 2026-02-12T20:43:19.186 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:43:19.186 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:43:19.186 INFO:tasks.workunit.client.0.trial099.stderr:512 bytes copied, 5.7477e-05 s, 8.9 MB/s 2026-02-12T20:43:19.186 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:19.187 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:19.187 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-12T20:43:19.187 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-12T20:43:19.187 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.vwR5gWf4Y7 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.vwR5gWf4Y7 bs=1000 count=1 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records in 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr:1+0 records out 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr:1000 bytes (1.0 kB) copied, 5.5063e-05 s, 18.2 MB/s 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.vwR5gWf4Y7 2026-02-12T20:43:19.188 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.vwR5gWf4Y7 2026-02-12T20:43:19.189 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-12T20:43:19.189 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-12T20:43:19.189 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:43:19.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:43:19.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-12T20:43:19.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:19.213 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:43:19.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:43:19.240 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:43:19.240 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:43:19.241 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:43:19.241 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:43:19.241 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:43:19.242 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:43:19.242 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:43:19.242 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:43:19.242 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:43:19.242 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.242 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.243 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:43:19.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:43:19.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get fsid 2026-02-12T20:43:19.286 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:43:19.286 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:43:19.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:43:19.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:43:19.287 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:43:19.287 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:43:19.287 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:43:19.287 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:43:19.288 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:43:19.288 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.288 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.288 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-mon.a.asok 2026-02-12T20:43:19.289 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:43:19.289 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.24351/ceph-mon.a.asok config get mon_host 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-12T20:43:19.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:19.433 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:43:19.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:43:19.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:43:19.455 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:43:19.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 618cbb80-3685-4f36-80e3-f28544a65e42' 2026-02-12T20:43:19.457 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:43:19.458 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:43:19.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBnO45p2eVXHBAA2WPz1tAyNQ5rWU8lgTgmgA== 2026-02-12T20:43:19.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBnO45p2eVXHBAA2WPz1tAyNQ5rWU8lgTgmgA=="}' 2026-02-12T20:43:19.467 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 618cbb80-3685-4f36-80e3-f28544a65e42 -i td/divergent-priors/0/new.json 2026-02-12T20:43:19.575 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:43:19.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-12T20:43:19.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBnO45p2eVXHBAA2WPz1tAyNQ5rWU8lgTgmgA== --osd-uuid 618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:43:19.603 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:19.612+0000 7fe621a32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:19.604 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:19.613+0000 7fe621a32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:19.605 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:19.614+0000 7fe621a32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:19.606 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:19.614+0000 7fe621a32780 -1 bdev(0x2d92c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:43:19.606 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:19.614+0000 7fe621a32780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-12T20:43:20.007 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-12T20:43:20.007 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:43:20.008 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:43:20.009 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:43:20.009 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:43:20.117 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:43:20.118 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:43:20.118 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:43:20.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:43:20.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:43:20.119 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:43:20.137 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:20.145+0000 7fe331662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:20.138 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:20.147+0000 7fe331662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:20.139 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:20.148+0000 7fe331662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:20.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:43:20.221 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:43:20.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:20.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:43:20.320 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:43:20.352 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:20.360+0000 7fe331662780 -1 Falling back to public interface 2026-02-12T20:43:20.738 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:20.747+0000 7fe331662780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:43:21.322 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:43:21.322 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:21.322 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:43:21.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:43:21.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:21.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:43:21.425 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1199469152,v1:127.0.0.1:6801/1199469152] [v2:127.0.0.1:6802/1199469152,v1:127.0.0.1:6803/1199469152] exists,up 618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:43:21.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:43:21.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:43:21.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0ec93127-bf9e-46ee-8856-bf390e7a759b 2026-02-12T20:43:21.433 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 0ec93127-bf9e-46ee-8856-bf390e7a759b 2026-02-12T20:43:21.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0ec93127-bf9e-46ee-8856-bf390e7a759b' 2026-02-12T20:43:21.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:43:21.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBpO45pDCHxGhAARgHXTROk8SiAHBTTunnFYQ== 2026-02-12T20:43:21.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBpO45pDCHxGhAARgHXTROk8SiAHBTTunnFYQ=="}' 2026-02-12T20:43:21.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0ec93127-bf9e-46ee-8856-bf390e7a759b -i td/divergent-priors/1/new.json 2026-02-12T20:43:21.556 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:43:21.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-12T20:43:21.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpO45pDCHxGhAARgHXTROk8SiAHBTTunnFYQ== --osd-uuid 0ec93127-bf9e-46ee-8856-bf390e7a759b 2026-02-12T20:43:21.584 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:21.592+0000 7ff0e2031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:21.585 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:21.594+0000 7ff0e2031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:21.586 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:21.595+0000 7ff0e2031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:21.587 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:21.595+0000 7ff0e2031780 -1 bdev(0x2e44c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:43:21.587 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:21.595+0000 7ff0e2031780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-12T20:43:21.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-12T20:43:21.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:43:21.917 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:43:21.918 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:43:21.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:43:22.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:43:22.238 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:43:22.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:43:22.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:43:22.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:43:22.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:43:22.256 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:22.265+0000 7fcfc6c2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:22.257 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:22.266+0000 7fcfc6c2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:22.258 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:22.267+0000 7fcfc6c2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:22.399 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:22.408+0000 7fcfc6c2c780 -1 Falling back to public interface 2026-02-12T20:43:22.469 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:43:22.469 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:43:22.469 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:43:22.469 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:43:22.469 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:43:22.469 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:22.470 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:43:22.470 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:43:22.470 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:22.470 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:43:22.696 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:22.704+0000 7fcfc6c2c780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:43:22.708 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:43:23.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:43:23.710 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:23.711 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:43:23.711 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:43:23.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:23.712 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:43:23.948 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/82943037,v1:127.0.0.1:6811/82943037] [v2:127.0.0.1:6812/82943037,v1:127.0.0.1:6813/82943037] exists,up 0ec93127-bf9e-46ee-8856-bf390e7a759b 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-12T20:43:23.953 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:43:23.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:43:23.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:43:23.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d7c76ec7-86f4-43b7-916e-b9ade9cc02db' 2026-02-12T20:43:23.957 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:43:23.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:43:23.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBrO45pb9IMOhAADY9gCw2ZM7Hoyaa3JDwBfQ== 2026-02-12T20:43:23.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBrO45pb9IMOhAADY9gCw2ZM7Hoyaa3JDwBfQ=="}' 2026-02-12T20:43:23.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d7c76ec7-86f4-43b7-916e-b9ade9cc02db -i td/divergent-priors/2/new.json 2026-02-12T20:43:24.195 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:43:24.203 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-12T20:43:24.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBrO45pb9IMOhAADY9gCw2ZM7Hoyaa3JDwBfQ== --osd-uuid d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:43:24.223 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.232+0000 7f3508bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:24.224 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.233+0000 7f3508bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:24.225 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.234+0000 7f3508bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:24.226 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.234+0000 7f3508bd8780 -1 bdev(0x275cc00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:43:24.226 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.234+0000 7f3508bd8780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-12T20:43:24.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-12T20:43:24.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:43:24.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:43:24.544 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:43:24.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:43:24.868 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:43:24.869 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:43:24.869 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:43:24.869 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:43:24.869 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:43:24.869 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:43:24.887 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.896+0000 7f223d414780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:24.888 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.897+0000 7f223d414780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:24.889 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:24.898+0000 7f223d414780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:25.024 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:25.032+0000 7f223d414780 -1 Falling back to public interface 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:25.098 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:43:25.318 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:25.326+0000 7f223d414780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:43:25.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:43:26.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:43:26.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:26.335 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:43:26.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:43:26.336 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:26.336 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:43:26.563 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/884574402,v1:127.0.0.1:6819/884574402] [v2:127.0.0.1:6820/884574402,v1:127.0.0.1:6821/884574402] exists,up d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:43:26.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:43:26.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:43:26.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:43:26.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-12T20:43:26.882 INFO:tasks.workunit.client.0.trial099.stderr:noout is set 2026-02-12T20:43:26.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-12T20:43:27.188 INFO:tasks.workunit.client.0.trial099.stderr:noin is set 2026-02-12T20:43:27.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-12T20:43:27.492 INFO:tasks.workunit.client.0.trial099.stderr:nodown is set 2026-02-12T20:43:27.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-12T20:43:27.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=test 2026-02-12T20:43:27.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-12T20:43:27.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-12T20:43:27.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-12T20:43:27.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-12T20:43:27.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-12T20:43:27.770 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-12T20:43:28.142 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' already exists 2026-02-12T20:43:28.149 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:43:29.151 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-12T20:43:29.152 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-12T20:43:29.468 INFO:tasks.workunit.client.0.trial099.stderr:set pool 1 allow_ec_overwrites to true 2026-02-12T20:43:29.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-12T20:43:29.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:43:29.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:43:29.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:43:29.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:43:29.480 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:43:29.480 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:43:29.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:43:29.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:43:29.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:43:29.566 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:43:29.566 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:43:29.566 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:43:29.566 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:43:29.566 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:43:29.566 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:43:29.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:43:29.795 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:43:29.795 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:43:29.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:43:29.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:29.795 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:43:29.866 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-12T20:43:29.866 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-12T20:43:29.866 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-12T20:43:29.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:29.867 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:43:29.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-12T20:43:29.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-12T20:43:29.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705669' 2026-02-12T20:43:29.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:29.934 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:43:30.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-12T20:43:30.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-12T20:43:30.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705669 2-60129542147' 2026-02-12T20:43:30.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:30.003 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-12T20:43:30.004 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:30.004 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:43:30.005 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-12T20:43:30.005 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:30.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-12T20:43:30.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-12T20:43:30.006 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836484 2026-02-12T20:43:30.006 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:30.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:43:30.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:43:31.242 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:43:31.242 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:31.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-12T20:43:31.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:43:32.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:43:32.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:32.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-12T20:43:32.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:32.715 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-12T20:43:32.715 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:32.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:43:32.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-12T20:43:32.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:32.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-12T20:43:32.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-12T20:43:32.718 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705669 2026-02-12T20:43:32.719 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:43:32.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-12T20:43:32.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:32.958 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-12T20:43:32.958 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:32.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:43:32.959 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-12T20:43:32.959 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:32.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-12T20:43:32.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-12T20:43:32.961 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542147 2026-02-12T20:43:32.961 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:43:33.188 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-12T20:43:33.189 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:43:33.189 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:43:33.189 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:43:33.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:43:33.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:43:33.522 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:43:33.522 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:43:33.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:43:33.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:43:33.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:43:33.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:43:33.745 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:43:33.746 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:43:33.746 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:43:33.747 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:43:34.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:43:34.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:43:34.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:43:34.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-12T20:43:34.081 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-12T20:43:34.082 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:43:34.082 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:43:34.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:43:34.308 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:43:34.309 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:43:34.309 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:43:34.309 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:34.309 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:43:34.379 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-12T20:43:34.379 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-12T20:43:34.379 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-12T20:43:34.379 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:34.379 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:43:34.447 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-12T20:43:34.447 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-12T20:43:34.447 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705672' 2026-02-12T20:43:34.447 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:34.447 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:43:34.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-12T20:43:34.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-12T20:43:34.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705672 2-60129542150' 2026-02-12T20:43:34.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:34.515 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-12T20:43:34.515 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:34.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:43:34.516 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-12T20:43:34.517 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:34.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-12T20:43:34.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-12T20:43:34.518 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836487 2026-02-12T20:43:34.518 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:34.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-12T20:43:34.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:43:35.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:43:35.758 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:35.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-12T20:43:35.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:35.990 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-12T20:43:35.990 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:35.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:43:35.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-12T20:43:35.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:35.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-12T20:43:35.992 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705672 2026-02-12T20:43:35.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-12T20:43:35.993 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:43:36.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-12T20:43:36.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:36.221 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-12T20:43:36.221 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:36.222 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:43:36.223 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-12T20:43:36.223 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:36.224 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-12T20:43:36.224 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-12T20:43:36.224 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542150 2026-02-12T20:43:36.224 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:43:36.459 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-12T20:43:36.459 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:43:36.460 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:43:36.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:43:36.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:43:36.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:43:36.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:43:36.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:43:36.546 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:43:36.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:43:36.777 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:43:36.777 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:43:36.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:43:36.778 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:36.778 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:43:36.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-12T20:43:36.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-12T20:43:36.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-12T20:43:36.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:36.850 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:43:36.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-12T20:43:36.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-12T20:43:36.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-12T20:43:36.918 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:36.918 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:43:36.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-12T20:43:36.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-12T20:43:36.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542153' 2026-02-12T20:43:36.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:36.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-12T20:43:36.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:36.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:43:36.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-12T20:43:36.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:36.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-12T20:43:36.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-12T20:43:36.990 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836490 2026-02-12T20:43:36.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:37.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-12T20:43:37.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:43:38.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:43:38.218 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:38.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-12T20:43:38.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:38.447 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-12T20:43:38.447 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:38.448 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:43:38.448 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-12T20:43:38.448 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:38.449 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-12T20:43:38.449 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-12T20:43:38.449 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705674 2026-02-12T20:43:38.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:43:38.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-12T20:43:38.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:38.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-12T20:43:38.677 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:38.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:43:38.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-12T20:43:38.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:38.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-12T20:43:38.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-12T20:43:38.679 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542153 2026-02-12T20:43:38.679 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:43:38.906 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-12T20:43:38.906 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:43:38.907 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:43:38.907 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:43:39.227 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:43:39.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:43:39.464 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:43:39.464 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:43:39.465 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:43:39.465 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:43:39.781 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:43:39.781 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:43:39.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:43:39.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-12T20:43:39.782 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-12T20:43:39.998 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:40.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-12T20:43:40.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-12T20:43:40.007 INFO:tasks.workunit.client.0.trial099.stdout:primary and soon to be divergent is 1 2026-02-12T20:43:40.007 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:43:40.227 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:43:40.227 INFO:tasks.workunit.client.0.trial099.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-12T20:43:28.814135+0000 0'0 28:18 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:52:54.559432+0000 0 0 2026-02-12T20:43:40.227 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:43:40.227 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:43:40.228 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:40.235 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-12T20:43:40.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-12T20:43:40.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-12T20:43:40.236 INFO:tasks.workunit.client.0.trial099.stdout:writing initial objects 2026-02-12T20:43:40.237 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-12T20:43:40.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.256 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.256 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.370 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.387 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.406 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.406 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.425 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.425 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.461 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.461 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.498 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.498 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.535 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.535 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.553 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.553 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.572 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.572 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.627 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.627 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.701 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.719 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.719 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.775 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.775 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.793 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.793 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.903 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.903 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.940 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.941 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.978 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.978 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:40.996 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:40.996 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.014 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.014 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.033 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.033 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.051 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.051 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.107 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.107 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.127 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.145 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.181 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.218 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.219 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.367 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.407 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.407 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.465 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.465 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.524 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.524 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.564 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.603 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.603 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.621 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.641 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.641 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.660 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.737 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.737 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.776 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.795 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.815 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.873 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.873 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.892 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.892 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.911 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.911 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.969 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.969 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:41.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:41.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.007 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:42.007 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:42.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:42.048 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:42.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:42.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-12T20:43:42.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:42.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:43:42.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:43:42.129 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:43:42.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:43:42.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:43:42.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:43:42.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:43:42.182 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:43:42.182 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:43:42.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:43:42.410 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:43:42.410 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:43:42.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:43:42.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:42.411 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:43:42.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-12T20:43:42.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-12T20:43:42.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-12T20:43:42.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:42.478 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:43:42.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705677 2026-02-12T20:43:42.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705677 2026-02-12T20:43:42.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705677' 2026-02-12T20:43:42.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:43:42.546 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:43:42.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-12T20:43:42.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-12T20:43:42.614 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705677 2-60129542156' 2026-02-12T20:43:42.614 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:42.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-12T20:43:42.614 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:42.615 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:43:42.615 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-12T20:43:42.616 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:42.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-12T20:43:42.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-12T20:43:42.617 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 21474836493 2026-02-12T20:43:42.617 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:42.848 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836493 2026-02-12T20:43:42.848 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:43:43.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:43:43.850 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:43:44.083 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-12T20:43:44.083 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:44.084 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705677 2026-02-12T20:43:44.084 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:44.084 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:43:44.085 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705677 2026-02-12T20:43:44.085 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:44.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705677 2026-02-12T20:43:44.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705677' 2026-02-12T20:43:44.087 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 38654705677 2026-02-12T20:43:44.087 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:43:44.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705677 -lt 38654705677 2026-02-12T20:43:44.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:43:44.314 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-12T20:43:44.314 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:43:44.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:43:44.315 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-12T20:43:44.315 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:43:44.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-12T20:43:44.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-12T20:43:44.317 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 60129542156 2026-02-12T20:43:44.318 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:43:44.553 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-12T20:43:44.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:43:44.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:43:44.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:43:44.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:43:44.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:43:44.890 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:43:44.890 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:43:44.890 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:43:44.891 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:43:44.891 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:43:44.891 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:43:45.116 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:43:45.117 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:43:45.117 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:43:45.117 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:43:45.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:43:45.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:43:45.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:43:45.442 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-12T20:43:45.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-12T20:43:45.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-12T20:43:45.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-12T20:43:45.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-12T20:43:45.670 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-12T20:43:45.671 INFO:tasks.workunit.client.0.trial099.stdout:blackholing osds 0 2 2026-02-12T20:43:45.671 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-12T20:43:45.671 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:43:45.889 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:43:45.889 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-12T20:43:28.814135+0000 28'100 28:118 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:52:54.559432+0000 0 0 2026-02-12T20:43:45.889 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:43:45.889 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:43:45.889 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:45.896 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:43:45.897 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-12T20:43:45.897 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:43:45.897 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:43:45.897 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:43:45.897 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:45.898 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:45.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:43:45.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-12T20:43:45.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-12T20:43:45.941 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:43:45.941 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:43:45.941 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:43:45.944 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:43:45.945 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:43:45.946 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-12T20:43:45.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-12T20:43:45.988 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:43:45.988 INFO:tasks.workunit.client.0.trial099.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-12T20:43:45.988 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:43:45.991 INFO:tasks.workunit.client.0.trial099.stdout:writing divergent object 2026-02-12T20:43:45.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-12T20:43:45.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-12T20:43:45.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.vwR5gWf4Y7 2026-02-12T20:43:46.994 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-12T20:43:46.994 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:47.067 INFO:tasks.workunit.client.0.trial099.stdout:created pool test snap snap1 2026-02-12T20:43:47.069 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-12T20:43:47.069 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-12T20:43:47.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:43:57.070 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-12T20:43:57.103 INFO:tasks.workunit.client.0.trial099.stderr:rados: no process found 2026-02-12T20:43:57.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-12T20:43:57.103 INFO:tasks.workunit.client.0.trial099.stdout:killing all the osds 2026-02-12T20:43:57.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:43:57.322 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:43:57.322 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-12T20:43:28.814135+0000 29'104 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T01:05:00.611221+0000 0 0 2026-02-12T20:43:57.323 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:43:57.323 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:43:57.323 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:57.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-12T20:43:57.331 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:43:57.331 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:43:57.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:43:57.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:43:57.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:43:57.438 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:43:57.438 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:57.438 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-12T20:43:57.672 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:43:57.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:57.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-12T20:43:57.960 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:43:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-12T20:43:57.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-12T20:43:58.249 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:43:58.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:43:58.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-12T20:43:58.537 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already out. 2026-02-12T20:43:58.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:43:58.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-12T20:43:58.824 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already out. 2026-02-12T20:43:58.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-12T20:43:58.832 INFO:tasks.workunit.client.0.trial099.stdout:bringing up non_divergent 0 2 2026-02-12T20:43:58.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:43:59.049 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:43:59.049 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-12T20:43:28.814135+0000 29'104 29:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T01:05:00.611221+0000 0 0 2026-02-12T20:43:59.049 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:43:59.049 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:43:59.049 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:43:59.059 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:43:59.060 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:43:59.061 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:43:59.062 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:43:59.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:43:59.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-12T20:43:59.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:43:59.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:43:59.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:43:59.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:43:59.077 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:59.085+0000 7fd8faa41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:59.078 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:59.086+0000 7fd8faa41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:59.079 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:59.087+0000 7fd8faa41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:43:59.214 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:59.221+0000 7fd8faa41780 -1 Falling back to public interface 2026-02-12T20:43:59.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:43:59.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:43:59.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:43:59.292 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:43:59.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:43:59.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:43:59.293 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:43:59.293 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:43:59.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:43:59.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:43:59.524 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:43:59.569 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:43:59.576+0000 7fd8faa41780 -1 osd.0 28 log_to_monitors true 2026-02-12T20:44:00.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:44:00.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:44:00.526 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:44:00.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:44:00.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:44:00.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:44:00.754 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/2335329031,v1:127.0.0.1:6801/2335329031] [v2:127.0.0.1:6802/2335329031,v1:127.0.0.1:6803/2335329031] exists,up 618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:44:00.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:44:00.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:44:00.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:44:00.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:44:00.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:44:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:44:00.762 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:44:00.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:44:00.763 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-12T20:44:00.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:44:00.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:44:00.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:44:00.763 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:44:00.776 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:00.784+0000 7fae80c47780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:00.777 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:00.786+0000 7fae80c47780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:00.778 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:00.786+0000 7fae80c47780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:00.911 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:00.919+0000 7fae80c47780 -1 Falling back to public interface 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:44:00.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:44:00.990 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:44:00.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:44:00.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:44:01.217 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:01.226+0000 7fae80c47780 -1 osd.2 28 log_to_monitors true 2026-02-12T20:44:01.218 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:44:02.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:44:02.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:44:02.220 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:44:02.221 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:44:02.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:44:02.221 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:44:02.450 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/3735203795,v1:127.0.0.1:6811/3735203795] [v2:127.0.0.1:6812/3735203795,v1:127.0.0.1:6813/3735203795] exists,up d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:44:02.451 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:44:02.451 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:44:02.452 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:44:02.452 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:44:02.452 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-12T20:44:02.699 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already in. 2026-02-12T20:44:02.706 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:44:02.706 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-12T20:44:02.991 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already in. 2026-02-12T20:44:02.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-12T20:44:08.001 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-12T20:44:08.002 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-12T20:44:08.002 INFO:tasks.workunit.client.0.trial099.stdout:writing non-divergent object existing_4 2026-02-12T20:44:08.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-12T20:44:08.003 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:44:08.221 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:44:08.221 INFO:tasks.workunit.client.0.trial099.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-12T20:44:03.039099+0000 28'100 42:128 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-13T21:05:36.748026+0000 0 0 2026-02-12T20:44:08.221 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:44:08.221 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:44:08.222 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:44:08.228 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.vwR5gWf4Y7 2026-02-12T20:44:08.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.vwR5gWf4Y7 2026-02-12T20:44:08.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:44:08.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-12T20:44:08.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:44:08.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:44:08.252 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:44:08.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:44:08.253 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:44:08.253 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:44:08.253 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:44:08.253 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:44:08.253 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:44:08.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:44:08.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:44:08.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:44:08.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:44:08.306 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:44:08.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:44:08.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:44:08.548 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:44:08.548 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:44:08.548 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:44:08.548 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:44:08.548 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:44:08.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-12T20:44:08.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-12T20:44:08.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660' 2026-02-12T20:44:08.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:44:08.617 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:44:08.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:44:08.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:44:08.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:44:08.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:44:08.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:44:08.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:44:08.741 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724548 2026-02-12T20:44:08.742 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724548 2026-02-12T20:44:08.742 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660 2-167503724548' 2026-02-12T20:44:08.742 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:44:08.742 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822660 2026-02-12T20:44:08.742 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:44:08.742 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:44:08.743 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822660 2026-02-12T20:44:08.744 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:44:08.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822660 2026-02-12T20:44:08.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2026-02-12T20:44:08.744 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 154618822660 2026-02-12T20:44:08.745 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:44:08.976 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822660 2026-02-12T20:44:08.976 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:44:09.977 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:44:09.978 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:44:10.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-12T20:44:10.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:44:10.216 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724548 2026-02-12T20:44:10.216 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:44:10.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:44:10.217 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724548 2026-02-12T20:44:10.217 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:44:10.219 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724548 2026-02-12T20:44:10.219 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724548' 2026-02-12T20:44:10.219 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 167503724548 2026-02-12T20:44:10.219 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:44:10.450 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724548 -lt 167503724548 2026-02-12T20:44:10.451 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:44:10.451 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:10.451 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:10.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:44:10.777 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:10.777 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:10.777 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:10.777 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:10.777 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:10.778 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:10.778 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:11.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:11.001 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:11.001 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:11.001 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:11.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:11.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:44:11.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:44:11.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:44:11.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:11.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:44:11.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:11.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:11.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:11.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:11.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:11.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:11.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:11.434 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:11.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:11.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:11.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:11.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:11.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:11.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:11.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:12.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:12.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:12.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:44:12.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:12.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:12.513 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:12.514 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:12.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:12.738 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:12.739 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:12.739 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:13.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:13.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:13.064 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:13.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:13.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:13.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:44:13.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:13.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:44:13.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:13.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:13.792 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:13.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:13.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:13.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:13.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:13.793 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:14.019 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:14.019 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:14.020 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:14.020 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:14.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:14.359 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:14.359 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:14.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:14.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:14.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:44:14.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:14.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:44:15.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:15.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:15.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:15.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:15.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:15.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:15.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:15.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:15.708 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:15.708 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:15.709 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:15.709 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:16.030 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:16.030 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:16.031 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:44:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:16.350 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:44:17.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:17.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:17.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:17.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:17.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:17.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:17.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:17.952 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:18.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:18.180 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:18.180 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:18.180 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:18.498 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:18.499 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:18.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:18.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:18.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:44:18.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:18.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:44:22.013 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:22.013 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:22.014 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:22.015 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:22.015 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:22.015 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:22.015 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:22.015 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:22.242 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:22.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:22.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:22.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:22.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:22.562 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:22.893 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:22.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:22.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:44:22.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:22.894 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:44:29.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:29.294 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:29.295 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:29.295 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:29.295 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:29.295 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:29.295 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:29.295 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:29.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:29.526 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:29.526 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:29.526 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:29.855 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:29.855 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:29.855 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:29.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:29.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:29.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:29.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:29.856 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:29.856 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:30.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:30.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:30.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:44:30.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:30.174 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:44:37.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:37.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:37.475 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:37.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:37.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:37.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:37.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:37.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:37.704 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:37.704 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:37.705 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:37.705 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:38.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:38.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:38.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:38.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:38.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:38.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:38.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:38.032 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:38.032 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:44:38.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:44:38.676 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "fc9502bd-f3ea-4ddd-98f7-74864edb2852", 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:44:38.685253+0000", 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:44:38.677 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:44:38.678 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:44:38.679 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:44:38.680 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:43:19.215072Z", 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:43:19.215072Z", 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:44:38.681 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:44:38.682 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:44:38.683 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:44:38.684 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:43:19:215067+0000", 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 42, 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:44:38.685 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:43:19.251840+0000", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:44:03.035461+0000", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:44:01.382220+0000", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:44:02.932160+0000", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:44:38.686 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 10, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:44:38.687 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:43:27.994408+0000", 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 16389, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "type": 3, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 1, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:44:38.688 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "off", 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 1, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 1, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 1, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 1, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:44:38.689 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "29", 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "0", 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "pool", 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 1, 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 29, 2026-02-12T20:44:38.690 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [ 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "snapid": 1, 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "stamp": "2026-02-12T20:43:47.020817+0000", 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "name": "snap1" 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:44:38.691 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "myprofile", 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.692 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 8192, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {} 2026-02-12T20:44:38.693 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "618cbb80-3685-4f36-80e3-f28544a65e42", 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 5, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 28, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 36, 2026-02-12T20:44:38.694 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 41, 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 30, 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.695 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.696 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.697 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.698 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2335329031 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/2335329031", 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/2335329031", 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2335329031", 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2335329031", 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:44:38.699 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "0ec93127-bf9e-46ee-8856-bf390e7a759b", 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:44:38.700 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 9, 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 24, 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 31, 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:44:38.701 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.702 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.703 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.704 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/82943037", 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/82943037", 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/82943037", 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/82943037", 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:44:38.705 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "d7c76ec7-86f4-43b7-916e-b9ade9cc02db", 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 14, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 28, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 39, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:44:38.706 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 32, 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.707 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:44:38.708 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.709 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:44:38.710 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 3735203795 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/3735203795", 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/3735203795", 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3735203795", 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3735203795", 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.711 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:43:57.614976+0000", 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:43:21.795026+0000", 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:43:57.904061+0000", 2026-02-12T20:44:38.712 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:43:23.669138+0000", 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:43:58.192320+0000", 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:44:38.713 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:43:26.281805+0000", 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:44:38.714 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "myprofile": { 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "crush-device-class": "", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "crush-failure-domain": "osd", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "crush-num-failure-domains": "0", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "crush-osds-per-failure-domain": "0", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "crush-root": "default", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "m": "1", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:44:38.715 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.716 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/2335329031,v1:127.0.0.1:6803/2335329031]", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:44:38.717 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:43:19.936184Z", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:44:38.718 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/2335329031,v1:127.0.0.1:6801/2335329031]", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2335329031,v1:127.0.0.1:6807/2335329031]", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2335329031,v1:127.0.0.1:6805/2335329031]", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:44:38.719 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/82943037,v1:127.0.0.1:6813/82943037]", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:44:38.720 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:44:38.721 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:43:21.881251Z", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/82943037,v1:127.0.0.1:6811/82943037]", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/82943037,v1:127.0.0.1:6817/82943037]", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/82943037,v1:127.0.0.1:6815/82943037]", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:44:38.722 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/3735203795,v1:127.0.0.1:6813/3735203795]", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:44:38.723 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:44:38.724 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:43:24.505166Z", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/3735203795,v1:127.0.0.1:6811/3735203795]", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3735203795,v1:127.0.0.1:6817/3735203795]", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3735203795,v1:127.0.0.1:6815/3735203795]", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:44:38.725 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 0, 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [] 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:44:38.726 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 36 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 39 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 42, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:44:38.727 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:44:38.728 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:44:38.729 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:44:38.730 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:44:38.731 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.732 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:44:38.733 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:44:38.734 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 1, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "test", 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "type": 3, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "op": "set_chooseleaf_tries", 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "num": 5 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "op": "set_choose_tries", 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "num": 100 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:44:38.735 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_indep", 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stderr:report 3795330205 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.736 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:44:38.737 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:43:19:251672+0000", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.738 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 1, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 52200, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 101, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 1, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 303, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 101, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 101, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:44:38.739 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.740 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 18, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 18, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "up": 3, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 3, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83916, 2026-02-12T20:44:38.741 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2140, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 28, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81699, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488884, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036617216, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2191360, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 1542362, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 29020, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83660452 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.742 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 83916, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2140, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 28, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 81699, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314488884, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322036617216, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2191360, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 1542362, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 29020, 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 83660452 2026-02-12T20:44:38.743 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 52200, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 101, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 1, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 303, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 101, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:44:38.744 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 101, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:44:38.745 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1241088, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 1241088, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 18, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 18, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "up": 3, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 3, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 154618822666 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 38654705680 2026-02-12T20:44:38.746 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 167503724554 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num": 1 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2147483647, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.747 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 1, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 3, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:44:25.448471+0000", 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "services": { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "osd": { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "daemons": { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "summary": "", 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "0": { 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.748 INFO:tasks.workunit.client.0.trial099.stdout: "2": { 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 40, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 233, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 322, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:44:38.749 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:44:38.750 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-12T20:44:38.791 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-12T20:44:38.888 INFO:tasks.workunit.client.0.trial099.stderr:PG '1.0' not found 2026-02-12T20:44:38.928 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-12T20:44:38.928 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-12T20:44:38.928 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:44:38.929 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:44:38.930 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:44:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:44:38.931 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-12T20:44:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:44:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:44:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:44:38.931 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:44:38.950 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:38.959+0000 7f1f06611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:38.952 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:38.960+0000 7f1f06611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:38.953 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:38.961+0000 7f1f06611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:39.074 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:39.083+0000 7f1f06611780 -1 Falling back to public interface 2026-02-12T20:44:39.162 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:44:39.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:44:39.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:44:39.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:44:39.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:44:39.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:44:39.163 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:44:39.164 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:44:39.164 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:44:39.164 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:44:39.373 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:39.382+0000 7f1f06611780 -1 osd.0 42 log_to_monitors true 2026-02-12T20:44:39.395 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 36 up_thru 41 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/2335329031,v1:127.0.0.1:6801/2335329031] [v2:127.0.0.1:6802/2335329031,v1:127.0.0.1:6803/2335329031] exists,up 618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:44:39.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:44:39.398 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:44:39.398 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:44:39.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:44:39.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-12T20:44:39.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:44:39.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:44:39.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-12T20:44:39.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:44:39.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-12T20:44:39.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-12T20:44:39.596 INFO:tasks.workunit.client.0.trial099.stderr:PG '1.0' not found 2026-02-12T20:44:39.642 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-12T20:44:39.642 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-12T20:44:39.642 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:44:39.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:44:39.644 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:44:39.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:44:39.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-12T20:44:39.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:44:39.646 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:44:39.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:44:39.647 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-12T20:44:39.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:44:39.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:44:39.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:44:39.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:44:39.659 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:39.667+0000 7fda1dc43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:39.660 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:39.668+0000 7fda1dc43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:39.661 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:39.669+0000 7fda1dc43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:44:39.799 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:39.807+0000 7fda1dc43780 -1 Falling back to public interface 2026-02-12T20:44:39.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:44:39.876 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:44:39.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:44:39.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:44:40.104 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/3735203795,v1:127.0.0.1:6811/3735203795] [v2:127.0.0.1:6812/3735203795,v1:127.0.0.1:6813/3735203795] exists,up d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-12T20:44:40.106 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-12T20:44:40.115 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:44:40.124+0000 7fda1dc43780 -1 osd.2 42 log_to_monitors true 2026-02-12T20:44:40.217 INFO:tasks.workunit.client.0.trial099.stderr:PG '1.0' not found 2026-02-12T20:44:40.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-12T20:44:40.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-12T20:44:40.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-12T20:44:40.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:44:40.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:44:40.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:44:40.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-12T20:44:40.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:44:40.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:44:40.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:44:40.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:44:40.311 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:44:40.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:44:40.546 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:44:40.546 INFO:tasks.workunit.client.0.trial099.stderr:2' 2026-02-12T20:44:40.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:44:40.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:44:40.546 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:44:40.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-12T20:44:40.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-12T20:44:40.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-193273528323' 2026-02-12T20:44:40.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:44:40.613 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:44:40.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-12T20:44:40.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-12T20:44:40.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-12T20:44:40.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-12T20:44:40.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:44:40.663 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:44:40.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397507 2026-02-12T20:44:40.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397507 2026-02-12T20:44:40.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-193273528323 2-210453397507' 2026-02-12T20:44:40.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:44:40.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-193273528323 2026-02-12T20:44:40.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:44:40.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:44:40.733 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-193273528323 2026-02-12T20:44:40.733 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:44:40.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528323 2026-02-12T20:44:40.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-12T20:44:40.734 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 193273528323 2026-02-12T20:44:40.735 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:44:40.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822666 -lt 193273528323 2026-02-12T20:44:40.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:44:41.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:44:41.967 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:44:42.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528323 -lt 193273528323 2026-02-12T20:44:42.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:44:42.197 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-210453397507 2026-02-12T20:44:42.197 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:44:42.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:44:42.198 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-210453397507 2026-02-12T20:44:42.198 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:44:42.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397507 2026-02-12T20:44:42.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-12T20:44:42.200 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 210453397507 2026-02-12T20:44:42.200 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:44:42.439 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-12T20:44:42.440 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:44:42.440 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:42.440 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:42.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:44:42.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:42.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:42.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:42.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:42.766 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:42.766 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:42.766 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:42.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:42.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:42.992 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:42.992 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:43.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:43.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-12T20:44:43.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-12T20:44:43.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-12T20:44:43.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:43.311 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-12T20:44:43.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:43.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:43.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:43.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:43.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:43.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:43.414 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:43.414 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:43.639 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:43.640 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:43.641 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:43.641 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:43.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:43.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:43.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:43.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:43.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:43.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:43.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:43.965 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:43.965 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:44.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:44.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:44.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-12T20:44:44.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:44.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-12T20:44:44.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:44.486 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:44.487 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:44.487 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:44.487 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:44.487 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:44.487 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:44.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:44.713 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:44.714 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:44.714 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:44.714 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:45.031 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:45.032 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:45.354 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:45.354 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:45.354 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-12T20:44:45.354 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:45.354 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-12T20:44:45.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:45.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:45.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:45.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:45.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:45.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:45.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:45.757 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:45.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:45.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:45.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:46.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:46.314 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:46.632 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:46.632 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:46.632 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-12T20:44:46.632 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:46.632 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-12T20:44:47.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:47.434 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:47.435 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:47.435 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:47.435 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:47.435 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:47.435 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:47.435 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:47.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:47.665 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:47.665 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:47.665 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:47.982 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:48.295 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:48.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:48.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-12T20:44:48.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:48.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-12T20:44:49.897 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:49.897 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:49.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:49.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:49.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:49.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:49.898 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:49.899 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:50.126 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:50.127 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:50.127 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:50.127 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:50.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:50.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:50.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:50.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:50.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-12T20:44:50.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:50.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-12T20:44:53.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:44:53.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:44:53.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:44:53.960 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:44:53.961 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:44:53.961 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:44:53.961 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:44:53.961 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:44:54.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:44:54.191 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:44:54.192 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:44:54.192 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:44:54.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:44:54.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:44:54.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:44:54.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-12T20:44:54.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:44:54.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-12T20:45:01.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:45:01.251 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:45:01.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:45:01.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:45:01.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:45:01.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:45:01.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:45:01.252 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:45:01.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:45:01.481 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:45:01.482 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:45:01.482 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:45:01.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:45:01.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:45:01.806 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:45:01.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:45:01.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:45:01.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:45:01.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:45:01.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:45:01.807 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:45:02.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:45:02.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:45:02.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-12T20:45:02.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-12T20:45:02.123 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-12T20:45:09.423 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-12T20:45:09.424 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:45:09.425 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:45:09.425 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:45:09.425 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:45:09.425 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:45:09.425 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:45:09.425 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:45:09.653 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-12T20:45:09.653 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:45:09.654 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:45:09.654 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:45:09.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-12T20:45:09.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-12T20:45:09.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-12T20:45:09.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-12T20:45:09.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-12T20:45:09.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-12T20:45:09.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-12T20:45:09.966 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-12T20:45:09.966 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-12T20:45:10.283 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-12T20:45:10.283 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-12T20:45:10.283 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-12T20:45:10.283 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-12T20:45:10.592 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:45:10.592 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_fingerprint": "fc9502bd-f3ea-4ddd-98f7-74864edb2852", 2026-02-12T20:45:10.592 INFO:tasks.workunit.client.0.trial099.stdout: "version": "20.3.0-5230-gafefaa40", 2026-02-12T20:45:10.592 INFO:tasks.workunit.client.0.trial099.stdout: "commit": "afefaa40503a4bf024e96f97dd7f852b75f00ad6", 2026-02-12T20:45:10.592 INFO:tasks.workunit.client.0.trial099.stdout: "timestamp": "2026-02-12T20:45:10.600583+0000", 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "tag": "", 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "health": { 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "status": "HEALTH_WARN", 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "checks": { 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "OSDMAP_FLAGS": { 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "count": 17 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [], 2026-02-12T20:45:10.593 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "OSD_DOWN": { 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "message": "1 osds down", 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: "message": "osd.1 (root=default,host=trial099) is down" 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.594 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "PG_DEGRADED": { 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "severity": "HEALTH_WARN", 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "summary": { 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "count": 1 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "detail": [ 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.595 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "muted": false 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "mutes": [] 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_first_committed": 1, 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "monmap_last_committed": 1, 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "monmap": { 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:45:10.596 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:43:19.215072Z", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:43:19.215072Z", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release": 20, 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "min_mon_release_name": "tentacle", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "election_strategy": 1, 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "disallowed_leaders": "", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": false, 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "tiebreaker_mon": "", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "removed_ranks": "", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "features": { 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "persistent": [ 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "kraken", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "luminous", 2026-02-12T20:45:10.597 INFO:tasks.workunit.client.0.trial099.stdout: "mimic", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap-prune", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "nautilus", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "octopus", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "pacific", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "elector-pinging", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "quincy", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "reef", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "squid", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "tentacle", 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "nvmeof_beacon_diff" 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: "optional": [] 2026-02-12T20:45:10.598 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "mons": [ 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "rank": 0, 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "name": "a", 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115", 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 0 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.599 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:7115/0", 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "priority": 0, 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 0, 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "time_added": "2026-02-12T20:43:19:215067+0000", 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "crush_location": [] 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: "quorum": [ 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: 0 2026-02-12T20:45:10.600 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap": { 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 50, 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "fsid": "7211ca13-36f4-4ea2-859c-ab873d2662c0", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "created": "2026-02-12T20:43:19.251840+0000", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:44:40.470284+0000", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "last_up_change": "2026-02-12T20:44:40.365546+0000", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "last_in_change": "2026-02-12T20:44:02.932160+0000", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "flags_num": 5800384, 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "flags_set": [ 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "nodown", 2026-02-12T20:45:10.601 INFO:tasks.workunit.client.0.trial099.stdout: "noin", 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "noout", 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "pglog_hardlimit", 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snapdirs", 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "recovery_deletes", 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "sortbitwise" 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "crush_version": 12, 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "full_ratio": 0.99000000953674316, 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_snapshot": "", 2026-02-12T20:45:10.602 INFO:tasks.workunit.client.0.trial099.stdout: "pool_max": 1, 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "max_osd": 3, 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "require_min_compat_client": "luminous", 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "min_compat_client": "jewel", 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "require_osd_release": "tentacle", 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "allow_crimson": false, 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "pools": [ 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "pool_name": "test", 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "create_time": "2026-02-12T20:43:27.994408+0000", 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "flags": 16389, 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-12T20:45:10.603 INFO:tasks.workunit.client.0.trial099.stdout: "type": 3, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "size": 3, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "min_size": 2, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "crush_rule": 1, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_count": 0, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_target": 0, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_barrier": 0, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "is_stretch_pool": false, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "object_hash": 2, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "pg_autoscale_mode": "off", 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num": 1, 2026-02-12T20:45:10.604 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num": 1, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "pg_placement_num_target": 1, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_target": 1, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "pg_num_pending": 1, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "last_pg_merge_meta": { 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "source_pgid": "0.0", 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "ready_epoch": 0, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_started": 0, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": 0, 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "source_version": "0'0", 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: "target_version": "0'0" 2026-02-12T20:45:10.605 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "last_change": "29", 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend": "0", 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "last_force_op_resend_preluminous": "0", 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "auid": 0, 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "snap_mode": "pool", 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "snap_seq": 1, 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "snap_epoch": 29, 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "pool_snaps": [ 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "snapid": 1, 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "stamp": "2026-02-12T20:43:47.020817+0000", 2026-02-12T20:45:10.606 INFO:tasks.workunit.client.0.trial099.stdout: "name": "snap1" 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps": "[]", 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_bytes": 0, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "quota_max_objects": 0, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "tiers": [], 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "tier_of": -1, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "read_tier": -1, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "write_tier": -1, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "cache_mode": "none", 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_bytes": 0, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "target_max_objects": 0, 2026-02-12T20:45:10.607 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_flush_age": 0, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "cache_min_evict_age": 0, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profile": "myprofile", 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_params": { 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "type": "none" 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_period": 0, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_count": 0, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "use_gmt_hitset": true, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "min_read_recency_for_promote": 0, 2026-02-12T20:45:10.608 INFO:tasks.workunit.client.0.trial099.stdout: "min_write_recency_for_promote": 0, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_grade_decay_rate": 0, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "hit_set_search_last_n": 0, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "grade_table": [], 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "stripe_width": 8192, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "expected_num_objects": 0, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "fast_read": false, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "nonprimary_shards": "{}", 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "options": {}, 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "application_metadata": {} 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: "osds": [ 2026-02-12T20:45:10.609 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "618cbb80-3685-4f36-80e3-f28544a65e42", 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 36, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 42, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 45, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 49, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 44, 2026-02-12T20:45:10.610 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6800", 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6801", 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.611 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6802", 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6803", 2026-02-12T20:45:10.612 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6806", 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.613 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6807", 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6804", 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.614 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6805", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2165625263 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6801/2165625263", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6803/2165625263", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2165625263", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2165625263", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:45:10.615 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "0ec93127-bf9e-46ee-8856-bf390e7a759b", 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "up": 0, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 0, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 0, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 9, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 24, 2026-02-12T20:45:10.616 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 31, 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.617 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:45:10.618 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:45:10.619 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.620 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 82943037 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/82943037", 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/82943037", 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/82943037", 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/82943037", 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: "exists" 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.621 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "uuid": "d7c76ec7-86f4-43b7-916e-b9ade9cc02db", 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "up": 1, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "in": 1, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 1, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "primary_affinity": 1, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_begin": 39, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "last_clean_end": 42, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 49, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "up_thru": 0, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "down_at": 48, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "lost_at": 0, 2026-02-12T20:45:10.622 INFO:tasks.workunit.client.0.trial099.stdout: "public_addrs": { 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6810", 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6811", 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.623 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addrs": { 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6812", 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6813", 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.624 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addrs": { 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6816", 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6817", 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.625 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addrs": { 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "addrvec": [ 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v2", 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6814", 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "type": "v1", 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "127.0.0.1:6815", 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: "nonce": 2767155786 2026-02-12T20:45:10.626 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "public_addr": "127.0.0.1:6811/2767155786", 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "cluster_addr": "127.0.0.1:6813/2767155786", 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2767155786", 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2767155786", 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "state": [ 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "exists", 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: "up" 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.627 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "osd_xinfo": [ 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:44:39.555249+0000", 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:43:21.795026+0000", 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:45:10.628 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:43:57.904061+0000", 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:43:23.669138+0000", 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "down_stamp": "2026-02-12T20:44:40.263702+0000", 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_probability": 0, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "laggy_interval": 0, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "features": 4544132024016699391, 2026-02-12T20:45:10.629 INFO:tasks.workunit.client.0.trial099.stdout: "old_weight": 0, 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "last_purged_snaps_scrub": "2026-02-12T20:43:26.281805+0000", 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "dead_epoch": 0 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap": [], 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_items": [], 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "pg_upmap_primaries": [], 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "pg_temp": [], 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "primary_temp": [], 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "blocklist": {}, 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "range_blocklist": {}, 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "erasure_code_profiles": { 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "default": { 2026-02-12T20:45:10.630 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "m": "2", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "myprofile": { 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "crush-device-class": "", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "crush-failure-domain": "osd", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "crush-num-failure-domains": "0", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "crush-osds-per-failure-domain": "0", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "crush-root": "default", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "k": "2", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "m": "1", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "plugin": "isa", 2026-02-12T20:45:10.631 INFO:tasks.workunit.client.0.trial099.stdout: "technique": "reed_sol_van" 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "removed_snaps_queue": [], 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "new_removed_snaps": [], 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "new_purged_snaps": [], 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "crush_node_flags": {}, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "device_class_flags": {}, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode": { 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_enabled": false, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_bucket_count": 0, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "degraded_stretch_mode": 0, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "recovering_stretch_mode": 0, 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: "stretch_mode_bucket": 0 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.632 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "osd_metadata": [ 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6802/2165625263,v1:127.0.0.1:6803/2165625263]", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:45:10.633 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:43:19.936184Z", 2026-02-12T20:45:10.634 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6800/2165625263,v1:127.0.0.1:6801/2165625263]", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2165625263,v1:127.0.0.1:6807/2165625263]", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2165625263,v1:127.0.0.1:6805/2165625263]", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:45:10.635 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/0", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/82943037,v1:127.0.0.1:6813/82943037]", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:45:10.636 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:45:10.637 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:43:21.881251Z", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/82943037,v1:127.0.0.1:6811/82943037]", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/82943037,v1:127.0.0.1:6817/82943037]", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/82943037,v1:127.0.0.1:6815/82943037]", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:45:10.638 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/1", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "arch": "x86_64", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "back_addr": "[v2:127.0.0.1:6812/2767155786,v1:127.0.0.1:6813/2767155786]", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "back_iface": "", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs": "1", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_db": "0", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_dedicated_wal": "0", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "bluefs_single_shared_device": "1", 2026-02-12T20:45:10.639 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocation_from_file": "1", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_allocator": "hybrid", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_access_mode": "file", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_block_size": "4096", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_devices": "nvme2n1", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_rotational": "0", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_size": "107374182400", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_support_discard": "1", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_bdev_type": "ssd", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_min_alloc_size": "4096", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "bluestore_write_mode": "classic", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_release": "tentacle", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_short": "20.3.0-5230-gafefaa40", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "ceph_version_when_created": "ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo)", 2026-02-12T20:45:10.640 INFO:tasks.workunit.client.0.trial099.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "created_at": "2026-02-12T20:43:24.505166Z", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "default_device_class": "ssd", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "device_ids": "nvme2n1=Micron_7450_MTFDKBA960TFR_25174FCD73B9", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "device_paths": "nvme2n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "devices": "nvme2n1", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "distro": "centos", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "distro_description": "CentOS Stream 9", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "distro_version": "9", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "front_addr": "[v2:127.0.0.1:6810/2767155786,v1:127.0.0.1:6811/2767155786]", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "front_iface": "", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2767155786,v1:127.0.0.1:6817/2767155786]", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2767155786,v1:127.0.0.1:6815/2767155786]", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "hostname": "trial099", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "journal_rotational": "0", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Feb 6 13:57:07 UTC 2026", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "kernel_version": "5.14.0-677.el9.x86_64", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "mem_swap_kb": "8388604", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "mem_total_kb": "130438948", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-12T20:45:10.641 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_node": "0", 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "objectstore_numa_nodes": "0", 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "os": "Linux", 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "osd_data": "td/divergent-priors/2", 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "osd_objectstore": "bluestore", 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "osdspec_affinity": "", 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "rotational": "0" 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_clean_epochs": { 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "min_last_epoch_clean": 25, 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "last_epoch_clean": { 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "per_pool": [ 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "floor": 25 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "osd_epochs": [ 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.642 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 49 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 50 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_first_committed": 1, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "osdmap_last_committed": 50, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "crushmap": { 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "devices": [ 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.0", 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.1", 2026-02-12T20:45:10.643 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd.2", 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "class": "ssd" 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "types": [ 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 0, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "name": "osd" 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "name": "host" 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 2, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "name": "chassis" 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.644 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 3, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "name": "rack" 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 4, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "name": "row" 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 5, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pdu" 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 6, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "name": "pod" 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 7, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "name": "room" 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 8, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: "name": "datacenter" 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.645 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 9, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "name": "zone" 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 10, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "name": "region" 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "name": "root" 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "buckets": [ 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "id": -1, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default", 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:45:10.646 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "id": -2, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "name": "default~ssd", 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 11, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "root", 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.647 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "id": -3, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099", 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:45:10.648 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "id": -4, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "name": "trial099~ssd", 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "type_id": 1, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "type_name": "host", 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 19206, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "alg": "straw2", 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "hash": "rjenkins1", 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "items": [ 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "id": 0, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 0 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "id": 1, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 1 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "id": 2, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "weight": 6402, 2026-02-12T20:45:10.649 INFO:tasks.workunit.client.0.trial099.stdout: "pos": 2 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "rules": [ 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 0, 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "replicated_rule", 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "type": 1, 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_firstn", 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.650 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "rule_id": 1, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "rule_name": "test", 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "type": 3, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "steps": [ 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "op": "set_chooseleaf_tries", 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "num": 5 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "op": "set_choose_tries", 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "num": 100 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "op": "take", 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "item": -1, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "item_name": "default" 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "op": "choose_indep", 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "num": 0, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: "type": "osd" 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.651 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "op": "emit" 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: ] 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "tunables": { 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_tries": 0, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "choose_local_fallback_tries": 0, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "choose_total_tries": 50, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_descend_once": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_vary_r": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "chooseleaf_stable": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "msr_descents": 100, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "msr_collision_tries": 100, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "straw_calc_version": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "allowed_bucket_algs": 54, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "profile": "jewel", 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "optimal_tunables": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "legacy_tunables": 0, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "minimum_required_version": "jewel", 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables2": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "has_v2_rules": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables3": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "has_v3_rules": 0, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "has_v4_buckets": 1, 2026-02-12T20:45:10.652 INFO:tasks.workunit.client.0.trial099.stdout: "require_feature_tunables5": 1, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "has_v5_rules": 0, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "has_msr_rules": 0 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "choose_args": {} 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "fsmap": { 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 1, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "btime": "2026-02-12T20:43:19:251672+0000", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "default_fscid": -1, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "compat": { 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "compat": {}, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "ro_compat": {}, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "incompat": { 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_1": "base v0.20", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_2": "client writeable ranges", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_3": "default file layouts on dirs", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_4": "dir inode in separate object", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_5": "mds uses versioned encoding", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_8": "no anchor table", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_9": "file layout v2", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_10": "snaprealm v2", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_11": "minor log segments", 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_12": "quiesce subvolumes" 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.653 INFO:tasks.workunit.client.0.trial099.stdout: "feature_flags": { 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "enable_multiple": true, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "ever_enabled_multiple": true 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "standbys": [], 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "filesystems": [] 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_first_committed": 1, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "mdsmap_last_committed": 1, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "auth": { 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 5, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_secrets": 3 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_active": 1, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_unknown": 0, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_osd": 3, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "pool_sum": { 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 52200, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 101, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 1, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 303, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 101, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:45:10.654 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 101, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:45:10.655 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 18, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 18, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "up": 3, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 3, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 0 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum": { 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:45:10.656 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 85068, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2268, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 31, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 82720, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314487732, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322035437568, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2322432, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 1596302, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 32251, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 84705797 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:45:10.657 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "osd_sum_by_class": { 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "ssd": { 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "up_from": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "num_pgs": 3, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "num_osds": 3, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_osds": 3, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "num_per_pool_omap_osds": 3, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "kb": 314572800, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used": 85068, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_data": 2268, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_omap": 31, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "kb_used_meta": 82720, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "kb_avail": 314487732, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "statfs": { 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "total": 322122547200, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "available": 322035437568, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 2322432, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 1596302, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:45:10.658 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 32251, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 84705797 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "hb_peers": [], 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "snap_trim_queue_len": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_snap_trimming": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_shards_repaired": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "op_queue_age_hist": { 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "histogram": [], 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "upper_bound": 1 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "perf_stat": { 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ms": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ms": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "commit_latency_ns": 0, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "apply_latency_ns": 0 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "alerts": [], 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "network_ping_times": [] 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "pool_stats": [ 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": 1, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg": 1, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "stat_sum": { 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes": 52200, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects": 101, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_clones": 1, 2026-02-12T20:45:10.659 INFO:tasks.workunit.client.0.trial099.stdout: "num_object_copies": 303, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing_on_primary": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_missing": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_degraded": 101, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_misplaced": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_unfound": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_dirty": 101, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_whiteouts": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_read": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_read_kb": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_write": 101, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_write_kb": 101, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_scrub_errors": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_shallow_scrub_errors": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_deep_scrub_errors": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_recovered": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_recovered": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_keys_recovered": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_omap": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_hit_set_archive": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_bytes_hit_set_archive": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_kb": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_kb": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_promote": 0, 2026-02-12T20:45:10.660 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_high": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_flush_mode_low": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_some": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_evict_mode_full": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_pinned": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_legacy_snapsets": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_large_omap_objects": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_manifest": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_bytes": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_omap_keys": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_objects_repaired": 0 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "store_stats": { 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "total": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "available": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "internally_reserved": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "allocated": 1241088, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "data_stored": 1241088, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_allocated": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "data_compressed_original": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "omap_allocated": 0, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "internal_metadata": 0 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "log_size": 18, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "ondisk_log_size": 18, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "up": 3, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "acting": 3, 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "num_store_stats": 3 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.661 INFO:tasks.workunit.client.0.trial099.stdout: "osd_stats": [ 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 193273528328 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 38654705680 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "seq": 210453397512 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_state": [ 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "state": "active+undersized+degraded", 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "num": 1 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "pool_pg_unavailable_map": [ 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "poolid": "1", 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "pgs": [] 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "num_pg_by_osd": [ 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2147483647, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.662 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 2, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 0, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 1, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 1, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "osd": 1, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_primary_pg": 0, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_acting_pg": 0, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "num_up_not_acting_pg": 0 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": [ 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "pool": 1, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "purged_snaps": {} 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: ], 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "servicemap": { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "epoch": 3, 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "modified": "2026-02-12T20:44:25.448471+0000", 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "services": { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "osd": { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "daemons": { 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "summary": "", 2026-02-12T20:45:10.663 INFO:tasks.workunit.client.0.trial099.stdout: "0": { 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "2": { 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "start_epoch": 0, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "start_stamp": "0.000000", 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "gid": 0, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "metadata": {}, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "task_status": {} 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: }, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_first_committed": 1, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "mgrstat_last_committed": 56, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "logm_first_committed": 1, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "logm_last_committed": 312, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "paxos": { 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "first_committed": 1, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "last_committed": 424, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "last_pn": 0, 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: "accepted_pn": 0 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout: } 2026-02-12T20:45:10.664 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:45:10.665 INFO:tasks.workunit.client.0.trial099.stderr:report 2414074293 2026-02-12T20:45:10.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-12T20:45:10.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-12T20:45:10.665 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery 2026-02-12T20:45:10.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:10.815 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:10.815 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 50:142 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:10.815 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:10.816 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:10.816 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:10.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:10.823 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.0.asok 2026-02-12T20:45:10.824 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-12T20:45:10.824 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.0.asok set_recovery_delay 100000 2026-02-12T20:45:10.868 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:45:10.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-12T20:45:10.872 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-12T20:45:10.872 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-12T20:45:10.872 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-12T20:45:10.872 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:45:10.872 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:10.873 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:10.873 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.2.asok 2026-02-12T20:45:10.873 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-12T20:45:10.873 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.2.asok set_recovery_delay 100000 2026-02-12T20:45:10.920 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:45:10.925 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-12T20:45:10.925 INFO:tasks.workunit.client.0.trial099.stdout:revive divergent 1 2026-02-12T20:45:10.925 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:11.143 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:11.143 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 50:142 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:11.143 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:11.143 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:11.143 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:11.150 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-12T20:45:11.467 INFO:tasks.workunit.client.0.trial099.stderr:noup is set 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:11.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:11.476 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:45:11.477 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:11.478 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:45:11.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:45:11.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:45:11.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:45:11.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:45:11.497 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:11.506+0000 7fb60dc40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:11.498 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:11.507+0000 7fb60dc40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:11.499 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:11.508+0000 7fb60dc40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:11.637 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:11.646+0000 7fb60dc40780 -1 Falling back to public interface 2026-02-12T20:45:11.706 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-12T20:45:11.706 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-12T20:45:11.893 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:11.901+0000 7fb60dc40780 -1 osd.1 29 log_to_monitors true 2026-02-12T20:45:16.708 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-12T20:45:16.708 INFO:tasks.workunit.client.0.trial099.stdout:delay recovery divergent 2026-02-12T20:45:16.709 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:16.927 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:16.927 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:16.927 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:16.927 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:16.927 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:16.934 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-12T20:45:16.935 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-12T20:45:16.935 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-12T20:45:16.935 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:45:16.935 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:16.935 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:16.935 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.24351/ceph-osd.1.asok 2026-02-12T20:45:16.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-12T20:45:16.936 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.24351/ceph-osd.1.asok set_recovery_delay 100000 2026-02-12T20:45:16.981 INFO:tasks.workunit.client.0.trial099.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-12T20:45:16.985 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-12T20:45:17.303 INFO:tasks.workunit.client.0.trial099.stderr:noup is unset 2026-02-12T20:45:17.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-12T20:45:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:45:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:17.315 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:17.315 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:17.316 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:17.316 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:17.316 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:45:17.543 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [36,42) [v2:127.0.0.1:6800/2165625263,v1:127.0.0.1:6801/2165625263] [v2:127.0.0.1:6802/2165625263,v1:127.0.0.1:6803/2165625263] exists,up 618cbb80-3685-4f36-80e3-f28544a65e42 2026-02-12T20:45:17.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:17.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:17.544 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:17.545 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:17.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:17.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:45:17.778 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/4035383094,v1:127.0.0.1:6819/4035383094] [v2:127.0.0.1:6820/4035383094,v1:127.0.0.1:6821/4035383094] exists,up 0ec93127-bf9e-46ee-8856-bf390e7a759b 2026-02-12T20:45:17.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:17.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:17.781 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:17.781 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:17.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:17.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:45:18.009 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [39,42) [v2:127.0.0.1:6810/2767155786,v1:127.0.0.1:6811/2767155786] [v2:127.0.0.1:6812/2767155786,v1:127.0.0.1:6813/2767155786] exists,up d7c76ec7-86f4-43b7-916e-b9ade9cc02db 2026-02-12T20:45:18.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:18.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:18.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:18.010 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:18.225 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:18.225 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:18.225 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:18.225 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:18.225 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:18.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-12T20:45:18.232 INFO:tasks.workunit.client.0.trial099.stdout:wait for peering 2026-02-12T20:45:18.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:18.447 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:18.448 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:18.448 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:18.448 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:18.448 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:18.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:45:18.475 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.Ln4GZ4uqRh 2026-02-12T20:45:18.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-12T20:45:18.476 INFO:tasks.workunit.client.0.trial099.stdout:killing divergent 1 2026-02-12T20:45:18.476 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:18.692 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:18.693 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:18.693 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:18.693 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:18.693 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:18.699 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-12T20:45:18.700 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:45:18.700 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:45:18.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:45:18.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:45:18.700 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:45:18.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:45:18.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-12T20:45:18.807 INFO:tasks.workunit.client.0.trial099.stdout:reviving divergent 1 2026-02-12T20:45:18.807 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:19.026 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:19.026 INFO:tasks.workunit.client.0.trial099.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-12T20:44:40.476533+0000 42'102 53:148 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T02:26:04.163258+0000 0 0 2026-02-12T20:45:19.026 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:19.026 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:19.026 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:19.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-12T20:45:19.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-12T20:45:19.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:45:19.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:45:19.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:45:19.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:19.035 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:45:19.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-12T20:45:19.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:45:19.037 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:45:19.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=7211ca13-36f4-4ea2-859c-ab873d2662c0 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.24351/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:19.037 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-12T20:45:19.038 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:45:19.038 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:45:19.038 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:45:19.038 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:45:19.055 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:19.064+0000 7f039d3dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:19.056 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:19.065+0000 7f039d3dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:19.057 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:19.066+0000 7f039d3dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:19.178 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:19.186+0000 7f039d3dd780 -1 Falling back to public interface 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:19.271 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:45:19.492 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:19.500+0000 7f039d3dd780 -1 osd.1 56 log_to_monitors true 2026-02-12T20:45:19.503 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/4035383094,v1:127.0.0.1:6819/4035383094] [v2:127.0.0.1:6820/4035383094,v1:127.0.0.1:6821/4035383094] exists,up 0ec93127-bf9e-46ee-8856-bf390e7a759b 2026-02-12T20:45:19.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:19.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:19.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:19.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-12T20:45:39.505 INFO:tasks.workunit.client.0.trial099.stdout:allowing recovery 2026-02-12T20:45:39.505 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-12T20:45:39.506 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:39.727 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:39.727 INFO:tasks.workunit.client.0.trial099.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-12T20:45:19.877747+0000 56'103 60:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T06:56:24.943801+0000 0 0 2026-02-12T20:45:39.727 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:39.727 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:39.728 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:39.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-12T20:45:39.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-12T20:45:39.796 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:45:39.800 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-12T20:45:39.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-12T20:45:39.862 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:45:39.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-12T20:45:39.867 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-12T20:45:39.928 INFO:tasks.workunit.client.0.trial099.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-12T20:45:39.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-12T20:45:39.934 INFO:tasks.workunit.client.0.trial099.stdout:reading divergent objects 2026-02-12T20:45:39.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-12T20:45:40.149 INFO:tasks.workunit.client.0.trial099.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-12T20:45:40.149 INFO:tasks.workunit.client.0.trial099.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-12T20:45:19.877747+0000 56'103 60:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-12T20:43:28.089672+0000 0'0 2026-02-12T20:43:28.089672+0000 0 0 periodic scrub scheduled @ 2026-02-14T06:56:24.943801+0000 0 0 2026-02-12T20:45:40.149 INFO:tasks.workunit.client.0.trial099.stdout: 2026-02-12T20:45:40.150 INFO:tasks.workunit.client.0.trial099.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-12T20:45:40.150 INFO:tasks.workunit.client.0.trial099.stderr:dumped pgs 2026-02-12T20:45:40.156 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-12T20:45:40.157 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-12T20:45:40.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:45:40.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-12T20:45:40.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:45:40.178 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-12T20:45:40.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:45:40.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-12T20:45:40.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-12T20:45:40.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-12T20:45:40.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-12T20:45:40.237 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-12T20:45:40.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:45:40.242 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-12T20:43:42.115104+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:45:40.242 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: keeping 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-12T20:43:42.115104+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 28'99 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-12T20:43:47.097697+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: keeping 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-12T20:43:47.097697+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 28'99 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-12T20:45:40.243 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-12T20:45:40.244 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:45:40.244 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 29'104 2026-02-12T20:45:40.244 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-12T20:43:47.097697+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-12T20:45:40.244 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-12T20:45:40.244 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-12T20:43:46.018108+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-12T20:43:47.023000+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-12T20:43:46.018108+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 20 _merge_object_divergent_entries: keeping 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-12T20:43:47.023000+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'102 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'104 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-12T20:43:47.023000+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-12T20:45:40.245 INFO:tasks.workunit.client.0.trial099.stdout:td/divergent-priors/osd.1.log:2026-02-12T20:45:18.286+0000 7fb5eb1fd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-12T20:45:40.246 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-12T20:45:40.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-12T20:45:40.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-12T20:45:40.249 INFO:tasks.workunit.client.0.trial099.stdout:success 2026-02-12T20:45:40.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-12T20:45:40.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-12T20:45:40.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-12T20:45:40.526 INFO:tasks.workunit.client.0.trial099.stderr:pool 'test' does not exist 2026-02-12T20:45:40.534 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-12T20:45:40.535 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:45:40.535 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:45:40.536 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:45:40.536 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:45:40.536 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:45:45.848 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:45:45.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-12T20:45:45.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:45:45.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:45:45.849 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:45:45.849 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:45:45.849 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:45:45.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:45:45.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:45:45.850 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:45:45.855 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:45:45.855 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:45:45.856 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:45:45.856 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:45:45.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:45:45.858 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:45:45.858 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:45:45.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:45:45.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:45:45.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:45:45.859 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:45:45.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:45:45.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:45:45.861 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:45:45.877 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:45:45.877 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:45.877 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:45.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:45:45.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:45:45.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:45:45.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-12T20:45:45.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/divergent-priors 0 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:45:45.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:45:45.881 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:45:45.881 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:45:45.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:45:45.882 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:45:45.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:45:45.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:45:45.883 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:45:45.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:45:45.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:45:45.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:45:45.885 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:45:45.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:45:45.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-12T20:45:45.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-12T20:45:45.888 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:45:45.888 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:45.888 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.24351 2026-02-12T20:45:45.888 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.24351 2026-02-12T20:45:45.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:45:45.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:45:45.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-12T20:45:45.890 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T20:45:45.891 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T20:45:45.918 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-12T20:45:45.919 DEBUG:teuthology.orchestra.run.trial099:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-12T20:45:45.981 INFO:tasks.workunit.client.0.trial099.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-12T20:45:45.985 INFO:tasks.workunit.client.0.trial099.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/ec-error-rollforward 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-12T20:45:45.986 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none ' 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-12T20:45:45.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-12T20:45:45.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-12T20:45:45.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-12T20:45:45.988 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-12T20:45:45.990 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:45:45.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:45:45.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:45:45.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:45:45.992 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:45:45.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:45:45.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:45:45.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:45:45.993 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:45:45.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:45:45.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:45:45.994 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-12T20:45:45.995 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:45:45.995 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:45.995 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:45.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.79106 2026-02-12T20:45:45.996 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:45:45.996 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:45:45.996 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-12T20:45:45.997 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:45:45.997 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:45.997 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:45.997 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.79106 2026-02-12T20:45:45.998 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:45:45.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-12T20:45:45.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-12T20:45:45.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:45:45.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-12T20:45:46.000 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:46.018 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:45:46.042 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:45:46.044 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:45:46.044 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:45:46.044 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:45:46.044 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:45:46.044 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.79106/ceph-mon.a.asok 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:45:46.045 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.79106/ceph-mon.a.asok config get fsid 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:45:46.089 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:46.090 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:46.090 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.79106/ceph-mon.a.asok 2026-02-12T20:45:46.090 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:45:46.090 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.79106/ceph-mon.a.asok config get mon_host 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-12T20:45:46.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:45:46.227 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:45:46.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:46.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:46.228 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:46.228 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:46.228 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:46.228 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:46.229 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:45:46.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:46.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:46.247 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:45:46.248 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:45:46.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-12T20:45:46.249 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:45:46.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7c1debbb-f3de-4fb8-8289-417d6d5bd502 2026-02-12T20:45:46.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 7c1debbb-f3de-4fb8-8289-417d6d5bd502' 2026-02-12T20:45:46.249 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 7c1debbb-f3de-4fb8-8289-417d6d5bd502 2026-02-12T20:45:46.250 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:45:46.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD6O45pk5i0DxAAF0L1cTiUOthXsDv3+TRX3w== 2026-02-12T20:45:46.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD6O45pk5i0DxAAF0L1cTiUOthXsDv3+TRX3w=="}' 2026-02-12T20:45:46.255 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7c1debbb-f3de-4fb8-8289-417d6d5bd502 -i td/ec-error-rollforward/0/new.json 2026-02-12T20:45:46.355 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:46.362 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-12T20:45:46.363 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6O45pk5i0DxAAF0L1cTiUOthXsDv3+TRX3w== --osd-uuid 7c1debbb-f3de-4fb8-8289-417d6d5bd502 2026-02-12T20:45:46.379 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.387+0000 7f9a7393d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:46.380 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.389+0000 7f9a7393d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:46.381 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.390+0000 7f9a7393d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:46.381 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.390+0000 7f9a7393d780 -1 bdev(0x3e72c00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:45:46.382 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.390+0000 7f9a7393d780 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-12T20:45:46.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-12T20:45:46.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:45:46.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:45:46.759 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:45:46.759 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:45:46.858 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:45:46.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:45:46.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:46.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:45:46.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:45:46.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:45:46.873 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.882+0000 7f0493a15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:46.875 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.884+0000 7f0493a15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:46.876 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:46.884+0000 7f0493a15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:46.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:45:46.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:46.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:45:46.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:46.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:46.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:46.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:46.960 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:46.960 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:46.961 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:45:47.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:45:47.081 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:47.090+0000 7f0493a15780 -1 Falling back to public interface 2026-02-12T20:45:47.351 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:47.359+0000 7f0493a15780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:45:48.056 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:45:48.056 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:48.057 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:45:48.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:45:48.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:48.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:45:48.153 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/394679310,v1:127.0.0.1:6801/394679310] [v2:127.0.0.1:6802/394679310,v1:127.0.0.1:6803/394679310] exists,up 7c1debbb-f3de-4fb8-8289-417d6d5bd502 2026-02-12T20:45:48.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:48.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:48.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:48.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-12T20:45:48.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:48.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:48.155 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=afbd97da-3ab0-4085-80d6-74110d010735 2026-02-12T20:45:48.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 afbd97da-3ab0-4085-80d6-74110d010735' 2026-02-12T20:45:48.157 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 afbd97da-3ab0-4085-80d6-74110d010735 2026-02-12T20:45:48.157 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:45:48.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD8O45p2vN4ChAAW5OwcijlIxwO8gk3Bib4qg== 2026-02-12T20:45:48.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD8O45p2vN4ChAAW5OwcijlIxwO8gk3Bib4qg=="}' 2026-02-12T20:45:48.166 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new afbd97da-3ab0-4085-80d6-74110d010735 -i td/ec-error-rollforward/1/new.json 2026-02-12T20:45:48.271 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:45:48.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-12T20:45:48.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD8O45p2vN4ChAAW5OwcijlIxwO8gk3Bib4qg== --osd-uuid afbd97da-3ab0-4085-80d6-74110d010735 2026-02-12T20:45:48.294 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.302+0000 7f80e3834780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:48.295 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.304+0000 7f80e3834780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:48.296 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.305+0000 7f80e3834780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:48.296 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.305+0000 7f80e3834780 -1 bdev(0x2c4ac00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:45:48.296 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.305+0000 7f80e3834780 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-12T20:45:48.624 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-12T20:45:48.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:45:48.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:45:48.626 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:45:48.626 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:45:48.936 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:45:48.937 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:45:48.938 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:48.938 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:45:48.938 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:45:48.938 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:45:48.950 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.959+0000 7f4378069780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:48.952 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.960+0000 7f4378069780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:48.953 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:48.961+0000 7f4378069780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:49.069 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:49.077+0000 7f4378069780 -1 Falling back to public interface 2026-02-12T20:45:49.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:45:49.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:49.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:45:49.157 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:49.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:49.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:49.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:49.158 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:49.159 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:49.159 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:45:49.382 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:49.390+0000 7f4378069780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:45:49.383 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:45:50.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:45:50.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:50.386 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:45:50.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:45:50.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:50.387 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:45:50.611 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3626055861,v1:127.0.0.1:6811/3626055861] [v2:127.0.0.1:6812/3626055861,v1:127.0.0.1:6813/3626055861] exists,up afbd97da-3ab0-4085-80d6-74110d010735 2026-02-12T20:45:50.615 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:50.616 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:50.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=31b0ff4a-45e0-4a04-bd5f-3473a94b1dff 2026-02-12T20:45:50.618 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 31b0ff4a-45e0-4a04-bd5f-3473a94b1dff' 2026-02-12T20:45:50.619 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 31b0ff4a-45e0-4a04-bd5f-3473a94b1dff 2026-02-12T20:45:50.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:45:50.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD+O45pEGDGJRAABs6Hdj0WF8qvvHW4oEXkKA== 2026-02-12T20:45:50.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD+O45pEGDGJRAABs6Hdj0WF8qvvHW4oEXkKA=="}' 2026-02-12T20:45:50.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 31b0ff4a-45e0-4a04-bd5f-3473a94b1dff -i td/ec-error-rollforward/2/new.json 2026-02-12T20:45:50.851 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:45:50.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-12T20:45:50.860 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD+O45pEGDGJRAABs6Hdj0WF8qvvHW4oEXkKA== --osd-uuid 31b0ff4a-45e0-4a04-bd5f-3473a94b1dff 2026-02-12T20:45:50.874 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:50.883+0000 7f0bf5c37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:50.875 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:50.884+0000 7f0bf5c37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:50.876 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:50.885+0000 7f0bf5c37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:50.877 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:50.885+0000 7f0bf5c37780 -1 bdev(0x2d8cc00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:45:50.877 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:50.885+0000 7f0bf5c37780 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-12T20:45:51.211 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-12T20:45:51.211 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:45:51.212 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:45:51.212 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:45:51.213 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:45:51.531 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:45:51.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:45:51.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:51.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:45:51.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:45:51.532 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:45:51.544 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:51.553+0000 7ffa56c48780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:51.546 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:51.554+0000 7ffa56c48780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:51.547 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:51.555+0000 7ffa56c48780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:51.673 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:51.681+0000 7ffa56c48780 -1 Falling back to public interface 2026-02-12T20:45:51.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:45:51.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:51.752 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:45:51.753 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:51.753 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:51.753 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:51.753 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:51.753 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:51.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:51.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:45:51.960 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:51.969+0000 7ffa56c48780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:45:51.978 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:45:52.979 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:45:52.980 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:52.980 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:45:52.981 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:45:52.981 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:52.981 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:45:53.203 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2991349979,v1:127.0.0.1:6819/2991349979] [v2:127.0.0.1:6820/2991349979,v1:127.0.0.1:6821/2991349979] exists,up 31b0ff4a-45e0-4a04-bd5f-3473a94b1dff 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:45:53.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:45:53.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:53.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=51d93797-8c03-44f1-a006-c2e5ace9c4f1 2026-02-12T20:45:53.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 51d93797-8c03-44f1-a006-c2e5ace9c4f1' 2026-02-12T20:45:53.211 INFO:tasks.workunit.client.0.trial099.stdout:add osd3 51d93797-8c03-44f1-a006-c2e5ace9c4f1 2026-02-12T20:45:53.211 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:45:53.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQABPI5pdTJmDRAAbXAuUkfSyIZpr3EaYDmdhw== 2026-02-12T20:45:53.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQABPI5pdTJmDRAAbXAuUkfSyIZpr3EaYDmdhw=="}' 2026-02-12T20:45:53.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 51d93797-8c03-44f1-a006-c2e5ace9c4f1 -i td/ec-error-rollforward/3/new.json 2026-02-12T20:45:53.441 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:45:53.448 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-12T20:45:53.449 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQABPI5pdTJmDRAAbXAuUkfSyIZpr3EaYDmdhw== --osd-uuid 51d93797-8c03-44f1-a006-c2e5ace9c4f1 2026-02-12T20:45:53.463 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:53.472+0000 7f2349862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:53.465 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:53.473+0000 7f2349862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:53.466 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:53.474+0000 7f2349862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:53.466 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:53.475+0000 7f2349862780 -1 bdev(0x3d30c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-12T20:45:53.466 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:53.475+0000 7f2349862780 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-12T20:45:53.784 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-12T20:45:53.785 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:45:53.785 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-12T20:45:53.786 INFO:tasks.workunit.client.0.trial099.stdout:adding osd3 key to auth repository 2026-02-12T20:45:53.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:45:54.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-12T20:45:54.103 INFO:tasks.workunit.client.0.trial099.stdout:start osd.3 2026-02-12T20:45:54.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:54.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:45:54.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:45:54.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:45:54.116 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:54.125+0000 7f1fd0a23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:54.117 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:54.126+0000 7f1fd0a23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:54.118 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:54.127+0000 7f1fd0a23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:54.243 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:54.251+0000 7f1fd0a23780 -1 Falling back to public interface 2026-02-12T20:45:54.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-12T20:45:54.329 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:54.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-12T20:45:54.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:54.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:54.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:54.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:54.330 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:54.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:54.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:45:54.534 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:54.542+0000 7f1fd0a23780 -1 osd.3 0 log_to_monitors true 2026-02-12T20:45:54.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:45:55.555 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:45:55.556 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:55.556 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:45:55.557 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:45:55.557 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:55.557 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:45:55.777 INFO:tasks.workunit.client.0.trial099.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2823420464,v1:127.0.0.1:6827/2823420464] [v2:127.0.0.1:6828/2823420464,v1:127.0.0.1:6829/2823420464] exists,up 51d93797-8c03-44f1-a006-c2e5ace9c4f1 2026-02-12T20:45:55.778 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:55.778 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:55.778 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:55.779 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-12T20:45:56.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-12T20:45:56.407 INFO:tasks.workunit.client.0.trial099.stderr:pool 'ec' already exists 2026-02-12T20:45:56.416 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-12T20:45:56.557 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-12T20:45:56.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 82923 2026-02-12T20:45:56.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=84886 2026-02-12T20:45:56.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-12T20:45:56.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-12T20:45:57.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 84907' 2026-02-12T20:45:57.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-12T20:45:57.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 84908' 2026-02-12T20:45:57.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-12T20:45:57.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 84909' 2026-02-12T20:45:57.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-12T20:45:57.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-12T20:45:58.561 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-12T20:45:58.562 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:45:58.562 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:45:58.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:45:58.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:45:58.563 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:45:58.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:45:58.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 84886 84907 84908 84909 2026-02-12T20:45:58.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:58.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:58.678 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-12T20:45:58.679 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:45:58.680 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:45:58.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:58.681 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-12T20:45:58.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:45:58.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:45:58.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:45:58.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:45:58.691 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:58.699+0000 7f33c8e83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:58.692 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:58.701+0000 7f33c8e83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:58.693 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:58.701+0000 7f33c8e83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:58.857 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:58.865+0000 7f33c8e83780 -1 Falling back to public interface 2026-02-12T20:45:58.903 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:45:58.903 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:58.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:45:58.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:58.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:58.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:58.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:58.904 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:58.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:58.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:45:59.124 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/394679310,v1:127.0.0.1:6801/394679310] [v2:127.0.0.1:6802/394679310,v1:127.0.0.1:6803/394679310] exists,up 7c1debbb-f3de-4fb8-8289-417d6d5bd502 2026-02-12T20:45:59.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:59.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:59.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:59.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-12T20:45:59.129 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:59.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:59.131 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-12T20:45:59.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:45:59.133 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:45:59.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:59.134 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-12T20:45:59.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:45:59.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:45:59.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:45:59.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:45:59.140 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.149+0000 7f291803a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:59.142 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.150+0000 7f291803a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:59.143 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.151+0000 7f291803a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:59.175 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.183+0000 7f33c8e83780 -1 osd.0 25 log_to_monitors true 2026-02-12T20:45:59.291 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.300+0000 7f291803a780 -1 Falling back to public interface 2026-02-12T20:45:59.355 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:45:59.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:59.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:45:59.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:59.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:59.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:59.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:59.357 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:59.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:59.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:45:59.582 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 10 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3626055861,v1:127.0.0.1:6811/3626055861] [v2:127.0.0.1:6812/3626055861,v1:127.0.0.1:6813/3626055861] exists,up afbd97da-3ab0-4085-80d6-74110d010735 2026-02-12T20:45:59.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:45:59.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:45:59.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:45:59.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:45:59.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:45:59.588 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:45:59.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:45:59.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-12T20:45:59.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:45:59.590 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:45:59.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:45:59.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-12T20:45:59.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:45:59.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:45:59.592 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:45:59.592 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:45:59.599 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.607+0000 7f5119c60780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:59.600 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.609+0000 7f5119c60780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:59.601 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.609+0000 7f5119c60780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:45:59.618 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.626+0000 7f291803a780 -1 osd.1 25 log_to_monitors true 2026-02-12T20:45:59.743 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:45:59.752+0000 7f5119c60780 -1 Falling back to public interface 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:45:59.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:45:59.810 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:45:59.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:45:59.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:46:00.041 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:00.082 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:00.091+0000 7f5119c60780 -1 osd.2 24 log_to_monitors true 2026-02-12T20:46:01.042 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:01.043 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:01.043 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:01.044 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:01.044 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:01.044 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:46:01.267 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 35 up_thru 0 down_at 29 last_clean_interval [15,24) [v2:127.0.0.1:6818/1292157360,v1:127.0.0.1:6819/1292157360] [v2:127.0.0.1:6820/1292157360,v1:127.0.0.1:6821/1292157360] exists,up 31b0ff4a-45e0-4a04-bd5f-3473a94b1dff 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:46:01.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:46:01.273 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-12T20:46:01.274 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-12T20:46:01.275 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-12T20:46:01.276 INFO:tasks.workunit.client.0.trial099.stdout:start osd.3 2026-02-12T20:46:01.276 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=9cc37dc9-53d3-4d9b-baaa-17ed814ef241 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.79106/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:46:01.277 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-12T20:46:01.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-12T20:46:01.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:46:01.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:46:01.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:46:01.283 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:01.291+0000 7f1459e30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:01.284 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:01.292+0000 7f1459e30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:01.285 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:01.293+0000 7f1459e30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:01.492 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:01.500+0000 7f1459e30780 -1 Falling back to public interface 2026-02-12T20:46:01.502 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-12T20:46:01.502 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:46:01.502 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-12T20:46:01.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:46:01.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:46:01.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:01.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:46:01.503 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:01.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:01.504 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:46:01.727 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:01.853 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:01.860+0000 7f1459e30780 -1 osd.3 25 log_to_monitors true 2026-02-12T20:46:02.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:02.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:02.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:02.730 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:02.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:02.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:46:02.956 INFO:tasks.workunit.client.0.trial099.stdout:osd.3 up in weight 1 up_from 38 up_thru 0 down_at 29 last_clean_interval [20,25) [v2:127.0.0.1:6826/1595723981,v1:127.0.0.1:6827/1595723981] [v2:127.0.0.1:6828/1595723981,v1:127.0.0.1:6829/1595723981] exists,up 51d93797-8c03-44f1-a006-c2e5ace9c4f1 2026-02-12T20:46:02.956 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:46:02.957 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:46:03.040 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:46:03.040 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:46:03.040 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:46:03.040 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:46:03.041 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:46:03.041 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:46:03.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:46:03.268 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:46:03.268 INFO:tasks.workunit.client.0.trial099.stderr:2 2026-02-12T20:46:03.268 INFO:tasks.workunit.client.0.trial099.stderr:3' 2026-02-12T20:46:03.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:46:03.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:46:03.268 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:46:03.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084291 2026-02-12T20:46:03.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084291 2026-02-12T20:46:03.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291' 2026-02-12T20:46:03.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:46:03.334 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:46:03.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953475 2026-02-12T20:46:03.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953475 2026-02-12T20:46:03.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291 1-137438953475' 2026-02-12T20:46:03.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:46:03.400 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:46:03.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-12T20:46:03.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-12T20:46:03.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291 1-137438953475 2-150323855363' 2026-02-12T20:46:03.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:46:03.462 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-12T20:46:03.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-12T20:46:03.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-12T20:46:03.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084291 1-137438953475 2-150323855363 3-163208757251' 2026-02-12T20:46:03.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:46:03.525 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-120259084291 2026-02-12T20:46:03.526 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:46:03.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:46:03.527 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-120259084291 2026-02-12T20:46:03.527 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:46:03.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084291 2026-02-12T20:46:03.528 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 120259084291' 2026-02-12T20:46:03.528 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 120259084291 2026-02-12T20:46:03.529 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:46:03.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 120259084291 2026-02-12T20:46:03.760 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:46:04.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:46:04.762 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:46:04.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084292 -lt 120259084291 2026-02-12T20:46:04.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:46:04.999 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953475 2026-02-12T20:46:04.999 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:46:04.999 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:46:05.000 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953475 2026-02-12T20:46:05.000 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:46:05.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953475 2026-02-12T20:46:05.001 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953475' 2026-02-12T20:46:05.002 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 137438953475 2026-02-12T20:46:05.002 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:46:05.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953475 -lt 137438953475 2026-02-12T20:46:05.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:46:05.230 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-150323855363 2026-02-12T20:46:05.230 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:46:05.230 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:46:05.231 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-12T20:46:05.231 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:46:05.233 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-12T20:46:05.233 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-12T20:46:05.233 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 150323855363 2026-02-12T20:46:05.233 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:46:05.458 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-12T20:46:05.458 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:46:05.459 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-163208757251 2026-02-12T20:46:05.459 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:46:05.460 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-12T20:46:05.461 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-163208757251 2026-02-12T20:46:05.461 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:46:05.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-12T20:46:05.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 163208757251' 2026-02-12T20:46:05.462 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.3 seq 163208757251 2026-02-12T20:46:05.463 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-12T20:46:05.694 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-12T20:46:05.694 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:46:05.695 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:46:05.695 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:46:06.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-12T20:46:06.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:46:06.016 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:46:06.016 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:46:06.017 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:46:06.017 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:46:06.017 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:46:06.017 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:46:06.234 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-12T20:46:06.235 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:46:06.235 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:46:06.235 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-12T20:46:06.554 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:46:06.555 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:46:06.555 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:46:06.555 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:46:06.555 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:46:06.662 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:46:06.662 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:46:06.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:46:06.663 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:46:06.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:46:06.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:46:06.665 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:46:06.666 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:06.666 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:46:06.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:46:06.667 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:06.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:46:06.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:46:06.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-12T20:46:06.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:46:06.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:46:06.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.79106 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/ec-error-rollforward 0 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-12T20:46:06.680 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-12T20:46:06.681 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:46:06.681 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:46:06.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:46:06.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:46:06.681 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:46:06.682 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:46:06.682 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:46:06.682 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:46:06.682 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:46:06.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:46:06.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:46:06.683 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:46:06.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:06.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:46:06.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:46:06.684 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:06.685 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:46:06.686 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-12T20:46:06.686 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-12T20:46:06.687 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:46:06.687 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.687 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.79106 2026-02-12T20:46:06.687 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.79106 2026-02-12T20:46:06.689 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:46:06.689 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:46:06.689 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-12T20:46:06.689 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T20:46:06.690 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T20:46:06.754 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-12T20:46:06.754 DEBUG:teuthology.orchestra.run.trial099:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-12T20:46:06.816 INFO:tasks.workunit.client.0.trial099.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-12T20:46:06.820 INFO:tasks.workunit.client.0.trial099.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-12T20:46:06.821 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bench 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=edb2a5a4-371d-4c99-b0e4-86e054ccc7af --auth-supported=none ' 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-12T20:46:06.822 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-12T20:46:06.825 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:46:06.826 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:06.828 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:46:06.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:46:06.829 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:06.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:46:06.830 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:46:06.830 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-12T20:46:06.831 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:46:06.831 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.831 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:06.831 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.87615 2026-02-12T20:46:06.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:46:06.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:46:06.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-12T20:46:06.833 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:46:06.833 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.833 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:06.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.87615 2026-02-12T20:46:06.835 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:46:06.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-12T20:46:06.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-12T20:46:06.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:46:06.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-12T20:46:06.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:06.853 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.87615/$cluster-$name.asok' 2026-02-12T20:46:06.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.87615/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:46:06.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:46:06.878 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.879 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:06.880 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.87615/ceph-mon.a.asok 2026-02-12T20:46:06.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:46:06.880 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.87615/ceph-mon.a.asok config get fsid 2026-02-12T20:46:06.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:46:06.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:46:06.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:46:06.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:46:06.924 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.87615/ceph-mon.a.asok 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:46:06.925 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.87615/ceph-mon.a.asok config get mon_host 2026-02-12T20:46:06.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-12T20:46:06.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-12T20:46:06.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:46:06.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:46:06.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:46:06.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-12T20:46:06.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:46:07.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:46:07.065 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:07.066 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:07.066 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:07.066 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:07.066 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:07.066 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.87615/$cluster-$name.asok' 2026-02-12T20:46:07.067 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:46:07.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.87615/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-12T20:46:07.085 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=edb2a5a4-371d-4c99-b0e4-86e054ccc7af --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:07.086 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.87615/$cluster-$name.asok' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.87615/$cluster-$name.asok' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:46:07.087 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a3ccaf53-409c-4276-bd8b-cce3f95358d1 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a3ccaf53-409c-4276-bd8b-cce3f95358d1' 2026-02-12T20:46:07.088 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 a3ccaf53-409c-4276-bd8b-cce3f95358d1 2026-02-12T20:46:07.089 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:46:07.094 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAPPI5pw+EkBhAAhaiozSB5KhlqKF0GMDKGUg== 2026-02-12T20:46:07.094 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAPPI5pw+EkBhAAhaiozSB5KhlqKF0GMDKGUg=="}' 2026-02-12T20:46:07.095 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a3ccaf53-409c-4276-bd8b-cce3f95358d1 -i td/osd-bench/0/new.json 2026-02-12T20:46:07.196 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:07.202 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-12T20:46:07.203 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=edb2a5a4-371d-4c99-b0e4-86e054ccc7af --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.87615/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAPPI5pw+EkBhAAhaiozSB5KhlqKF0GMDKGUg== --osd-uuid a3ccaf53-409c-4276-bd8b-cce3f95358d1 2026-02-12T20:46:07.219 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.226+0000 7fba79834780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:07.220 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.228+0000 7fba79834780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:07.221 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.229+0000 7fba79834780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:07.222 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.229+0000 7fba79834780 -1 bdev(0x405ac00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:46:07.222 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.229+0000 7fba79834780 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-12T20:46:07.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-12T20:46:07.655 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:46:07.655 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:46:07.655 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:46:07.656 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:46:07.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:46:07.757 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:46:07.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=edb2a5a4-371d-4c99-b0e4-86e054ccc7af --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.87615/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:46:07.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:46:07.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:46:07.758 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:46:07.770 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.778+0000 7f1788236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:07.771 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.779+0000 7f1788236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:07.772 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.780+0000 7f1788236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:07.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:46:07.857 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:46:07.858 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:46:07.858 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:46:07.858 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:46:07.858 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:07.858 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:46:07.858 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:07.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:07.859 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:46:07.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:07.979 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:07.986+0000 7f1788236780 -1 Falling back to public interface 2026-02-12T20:46:08.265 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:08.273+0000 7f1788236780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:46:08.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:08.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:08.958 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:08.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:08.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:08.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:46:09.054 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2613339393,v1:127.0.0.1:6801/2613339393] [v2:127.0.0.1:6802/2613339393,v1:127.0.0.1:6803/2613339393] exists,up a3ccaf53-409c-4276-bd8b-cce3f95358d1 2026-02-12T20:46:09.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:09.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:09.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:09.055 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-12T20:46:09.055 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-12T20:46:09.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-12T20:46:09.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-12T20:46:09.063 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-12T20:46:09.071 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-12T20:46:09.071 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-12T20:46:09.071 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-12T20:46:09.079 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-12T20:46:09.079 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-12T20:46:09.080 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-12T20:46:09.088 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-12T20:46:09.089 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-12T20:46:09.139 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-12T20:46:09.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-12T20:46:09.140 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-12T20:46:09.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-12T20:46:09.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-12T20:46:09.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-12T20:46:09.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-12T20:46:09.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-12T20:46:09.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-12T20:46:09.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-12T20:46:09.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-12T20:46:09.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-12T20:46:09.142 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-12T20:46:09.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-12T20:46:09.193 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-12T20:46:09.193 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-12T20:46:09.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-12T20:46:09.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-12T20:46:09.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-12T20:46:09.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-12T20:46:09.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-12T20:46:09.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-12T20:46:09.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-12T20:46:09.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-12T20:46:09.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-12T20:46:09.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-12T20:46:09.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-12T20:46:09.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-12T20:46:09.246 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-12T20:46:09.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-12T20:46:09.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-12T20:46:10.965 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:46:10.966 INFO:tasks.workunit.client.0.trial099.stdout: "bytes_written": 1073741824, 2026-02-12T20:46:10.966 INFO:tasks.workunit.client.0.trial099.stdout: "blocksize": 4194304, 2026-02-12T20:46:10.966 INFO:tasks.workunit.client.0.trial099.stdout: "elapsed_sec": 0.82136129899999999, 2026-02-12T20:46:10.966 INFO:tasks.workunit.client.0.trial099.stdout: "bytes_per_sec": 1307271021.0564718, 2026-02-12T20:46:10.966 INFO:tasks.workunit.client.0.trial099.stdout: "iops": 311.6776993409328 2026-02-12T20:46:10.966 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:46:10.972 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-12T20:46:11.030 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:46:11.030 INFO:tasks.workunit.client.0.trial099.stdout: "bytes_written": 10, 2026-02-12T20:46:11.030 INFO:tasks.workunit.client.0.trial099.stdout: "blocksize": 14456, 2026-02-12T20:46:11.031 INFO:tasks.workunit.client.0.trial099.stdout: "elapsed_sec": 0.00025817, 2026-02-12T20:46:11.031 INFO:tasks.workunit.client.0.trial099.stdout: "bytes_per_sec": 38734.167409071539, 2026-02-12T20:46:11.031 INFO:tasks.workunit.client.0.trial099.stdout: "iops": 2.679452643128911 2026-02-12T20:46:11.031 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:46:11.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-12T20:46:11.090 INFO:tasks.workunit.client.0.trial099.stdout:{ 2026-02-12T20:46:11.091 INFO:tasks.workunit.client.0.trial099.stdout: "bytes_written": 1, 2026-02-12T20:46:11.091 INFO:tasks.workunit.client.0.trial099.stdout: "blocksize": 14456, 2026-02-12T20:46:11.091 INFO:tasks.workunit.client.0.trial099.stdout: "elapsed_sec": 0.000152313, 2026-02-12T20:46:11.091 INFO:tasks.workunit.client.0.trial099.stdout: "bytes_per_sec": 6565.427770446383, 2026-02-12T20:46:11.091 INFO:tasks.workunit.client.0.trial099.stdout: "iops": 0.45416628185157604 2026-02-12T20:46:11.091 INFO:tasks.workunit.client.0.trial099.stdout:} 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:46:11.096 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:46:11.097 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:46:11.097 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:46:11.202 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:46:11.203 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:46:11.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:46:11.204 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:46:11.205 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:46:11.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:46:11.206 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:46:11.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:11.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:46:11.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:46:11.208 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:11.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:46:11.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:46:11.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-12T20:46:11.235 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:46:11.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.236 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:11.236 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.87615 2026-02-12T20:46:11.237 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bench 0 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:46:11.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:46:11.239 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:46:11.239 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:46:11.240 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:46:11.240 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:46:11.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:46:11.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:46:11.241 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:46:11.242 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:11.242 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:46:11.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:46:11.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:11.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:46:11.244 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-12T20:46:11.244 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-12T20:46:11.245 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:46:11.245 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.245 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.87615 2026-02-12T20:46:11.245 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.87615 2026-02-12T20:46:11.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:46:11.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:46:11.247 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-12T20:46:11.247 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T20:46:11.247 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T20:46:11.312 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-12T20:46:11.313 DEBUG:teuthology.orchestra.run.trial099:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-12T20:46:11.377 INFO:tasks.workunit.client.0.trial099.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-12T20:46:11.381 INFO:tasks.workunit.client.0.trial099.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-12T20:46:11.381 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bluefs-volume-ops 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.382 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-12T20:46:11.383 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-12T20:46:11.383 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-12T20:46:11.384 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-12T20:46:11.384 INFO:tasks.workunit.client.0.trial099.stderr:TEST_bluestore2 2026-02-12T20:46:11.384 INFO:tasks.workunit.client.0.trial099.stderr:TEST_bluestore_expand' 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:46:11.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:46:11.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:46:11.386 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:46:11.386 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:46:11.387 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:46:11.387 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:46:11.387 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:46:11.387 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:46:11.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:11.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:46:11.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:46:11.388 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:46:11.389 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:46:11.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:46:11.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-12T20:46:11.391 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:46:11.391 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.391 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.89625 2026-02-12T20:46:11.392 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:46:11.392 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:46:11.392 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-12T20:46:11.393 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:46:11.393 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.393 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.393 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.89625 2026-02-12T20:46:11.394 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-12T20:46:11.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-12T20:46:11.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-12T20:46:11.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-12T20:46:11.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-12T20:46:11.397 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-12T20:46:11.397 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=1 ' 2026-02-12T20:46:11.399 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-12T20:46:11.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:46:11.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:46:11.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:46:11.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-12T20:46:11.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.416 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:11.417 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:46:11.441 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:46:11.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:46:11.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:46:11.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:46:11.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:46:11.443 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.89625/ceph-mon.a.asok 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:46:11.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.89625/ceph-mon.a.asok config get fsid 2026-02-12T20:46:11.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:46:11.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.89625/ceph-mon.a.asok 2026-02-12T20:46:11.489 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:46:11.490 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.89625/ceph-mon.a.asok config get mon_host 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-12T20:46:11.530 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:46:11.629 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:46:11.629 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:11.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:11.630 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:11.630 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.630 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:11.630 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:46:11.631 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:46:11.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:11.650 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:46:11.651 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:46:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2655302f-6f0f-42d4-9816-2ae02f051ba8' 2026-02-12T20:46:11.653 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:46:11.653 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:46:11.657 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQATPI5pj3m4JxAAkRyuQ9naG+PXcQ4uTVQPRw== 2026-02-12T20:46:11.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQATPI5pj3m4JxAAkRyuQ9naG+PXcQ4uTVQPRw=="}' 2026-02-12T20:46:11.658 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2655302f-6f0f-42d4-9816-2ae02f051ba8 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-12T20:46:11.759 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:11.765 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-12T20:46:11.766 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQATPI5pj3m4JxAAkRyuQ9naG+PXcQ4uTVQPRw== --osd-uuid 2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:46:11.781 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:11.790+0000 7fc00f818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:11.783 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:11.792+0000 7fc00f818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:11.784 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:11.792+0000 7fc00f818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:11.784 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:11.793+0000 7fc00f818780 -1 bdev(0x242ac00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:46:11.784 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:11.793+0000 7fc00f818780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-12T20:46:12.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-12T20:46:12.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:46:12.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:46:12.677 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:46:12.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:46:12.781 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:46:12.781 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:46:12.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:46:12.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:46:12.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:46:12.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:46:12.795 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:12.804+0000 7f5ac262d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:12.796 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:12.805+0000 7f5ac262d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:12.797 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:12.806+0000 7f5ac262d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:12.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:46:12.878 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:12.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:12.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:46:12.972 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:13.094 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:13.103+0000 7f5ac262d780 -1 Falling back to public interface 2026-02-12T20:46:13.827 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:13.836+0000 7f5ac262d780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:46:13.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:13.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:13.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:13.974 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:13.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:13.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:46:14.209 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:15.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:15.210 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:15.211 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:46:15.211 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:46:15.211 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:15.211 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:46:15.436 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4110290775,v1:127.0.0.1:6801/4110290775] [v2:127.0.0.1:6802/4110290775,v1:127.0.0.1:6803/4110290775] exists,up 2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:46:15.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:15.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:15.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:15.442 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:46:15.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=90999 2026-02-12T20:46:15.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-12T20:46:15.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:15.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:46:15.445 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:46:15.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:46:15.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:46:15.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:46:15.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-12T20:46:15.446 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:46:15.446 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:46:15.447 INFO:tasks.workunit.client.0.trial099.stdout:add osd1 aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:46:15.448 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 aae959c7-19da-43d8-a586-8952da94623b' 2026-02-12T20:46:15.448 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:46:15.450 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAXPI5pOqBiGxAAf76ZpE+0sX6+FgLYkmJItA== 2026-02-12T20:46:15.451 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAXPI5pOqBiGxAAf76ZpE+0sX6+FgLYkmJItA=="}' 2026-02-12T20:46:15.451 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aae959c7-19da-43d8-a586-8952da94623b -i td/osd-bluefs-volume-ops/1/new.json 2026-02-12T20:46:15.676 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:15.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-12T20:46:15.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAXPI5pOqBiGxAAf76ZpE+0sX6+FgLYkmJItA== --osd-uuid aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:46:15.698 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:15.707+0000 7f32c922f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:15.700 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:15.708+0000 7f32c922f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:15.701 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:15.709+0000 7f32c922f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:15.701 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:15.710+0000 7f32c922f780 -1 bdev(0x2d62c00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-12T20:46:15.701 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:15.710+0000 7f32c922f780 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-12T20:46:16.384 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-12T20:46:16.384 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:46:16.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-12T20:46:16.385 INFO:tasks.workunit.client.0.trial099.stdout:adding osd1 key to auth repository 2026-02-12T20:46:16.385 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:46:16.697 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-12T20:46:16.697 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:46:16.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:46:16.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:46:16.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:46:16.698 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:46:16.710 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:16.719+0000 7fb802a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:16.711 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:16.720+0000 7fb802a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:16.712 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:16.721+0000 7fb802a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:16.888 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:16.896+0000 7fb802a0f780 -1 Falling back to public interface 2026-02-12T20:46:16.932 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-12T20:46:16.932 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:46:16.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:46:16.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:46:16.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:46:16.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:16.933 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:46:16.933 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:16.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:16.934 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:46:17.158 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:17.478 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:17.486+0000 7fb802a0f780 -1 osd.1 0 log_to_monitors true 2026-02-12T20:46:18.159 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:18.160 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:18.160 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:18.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:18.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:18.161 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:46:18.394 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/557725182,v1:127.0.0.1:6811/557725182] [v2:127.0.0.1:6812/557725182,v1:127.0.0.1:6813/557725182] exists,up aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:46:18.395 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:18.395 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:18.396 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:18.396 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-12T20:46:18.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=93317 2026-02-12T20:46:18.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-12T20:46:18.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:18.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:46:18.400 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:46:18.401 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:46:18.402 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:46:18.403 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-12T20:46:18.404 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:46:18.404 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:46:18.404 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 103b11f9-88ae-4d19-b4e5-707111abe8c6' 2026-02-12T20:46:18.404 INFO:tasks.workunit.client.0.trial099.stdout:add osd2 103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:46:18.405 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:46:18.409 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAaPI5pJL7wGBAA/dDYm2OEtQW/rgH+zuTmPg== 2026-02-12T20:46:18.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAaPI5pJL7wGBAA/dDYm2OEtQW/rgH+zuTmPg=="}' 2026-02-12T20:46:18.410 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 103b11f9-88ae-4d19-b4e5-707111abe8c6 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-12T20:46:18.637 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:46:18.645 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-12T20:46:18.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAaPI5pJL7wGBAA/dDYm2OEtQW/rgH+zuTmPg== --osd-uuid 103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:46:18.660 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:18.669+0000 7f44f0a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:18.662 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:18.671+0000 7f44f0a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:18.663 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:18.671+0000 7f44f0a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:18.663 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:18.672+0000 7f44f0a12780 -1 bdev(0x2d1ec00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-12T20:46:18.663 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:18.672+0000 7f44f0a12780 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-12T20:46:19.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-12T20:46:19.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:46:19.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-12T20:46:19.340 INFO:tasks.workunit.client.0.trial099.stdout:adding osd2 key to auth repository 2026-02-12T20:46:19.340 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:46:19.657 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-12T20:46:19.658 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:46:19.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:46:19.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:46:19.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:46:19.659 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:46:19.672 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:19.681+0000 7f719a831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:19.673 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:19.682+0000 7f719a831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:19.674 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:19.683+0000 7f719a831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:19.841 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:19.849+0000 7f719a831780 -1 Falling back to public interface 2026-02-12T20:46:19.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-12T20:46:19.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:46:19.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:46:19.882 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:46:19.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:46:19.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:19.883 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:19.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:46:19.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:19.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:46:20.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:20.375 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:20.383+0000 7f719a831780 -1 osd.2 0 log_to_monitors true 2026-02-12T20:46:21.107 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:21.107 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:21.107 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:21.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:21.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:21.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:46:21.338 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/413866530,v1:127.0.0.1:6819/413866530] [v2:127.0.0.1:6820/413866530,v1:127.0.0.1:6821/413866530] exists,up 103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:46:21.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:21.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:21.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:21.339 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=95439 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:46:21.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:46:21.344 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:46:21.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:46:21.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:46:21.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:46:21.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:46:21.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:46:21.346 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-12T20:46:21.346 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:46:21.347 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:46:21.347 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 bad5d750-4a8c-4eda-87ab-a29650f08020' 2026-02-12T20:46:21.347 INFO:tasks.workunit.client.0.trial099.stdout:add osd3 bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:46:21.347 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:46:21.353 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAdPI5pxzeVFRAAdzuexK8sDB1phwE+MiQcRw== 2026-02-12T20:46:21.353 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAdPI5pxzeVFRAAdzuexK8sDB1phwE+MiQcRw=="}' 2026-02-12T20:46:21.353 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bad5d750-4a8c-4eda-87ab-a29650f08020 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-12T20:46:21.583 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:46:21.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-12T20:46:21.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAdPI5pxzeVFRAAdzuexK8sDB1phwE+MiQcRw== --osd-uuid bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:46:21.606 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:21.615+0000 7fc87c027780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:21.607 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:21.616+0000 7fc87c027780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:21.608 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:21.617+0000 7fc87c027780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:21.609 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:21.617+0000 7fc87c027780 -1 bdev(0x2f84c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-12T20:46:21.609 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:21.617+0000 7fc87c027780 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-12T20:46:22.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-12T20:46:22.272 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:46:22.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-12T20:46:22.273 INFO:tasks.workunit.client.0.trial099.stdout:adding osd3 key to auth repository 2026-02-12T20:46:22.273 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:46:22.610 INFO:tasks.workunit.client.0.trial099.stdout:start osd.3 2026-02-12T20:46:22.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-12T20:46:22.612 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:46:22.612 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:46:22.612 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:46:22.612 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:46:22.624 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:22.633+0000 7f7d50c16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:22.626 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:22.635+0000 7f7d50c16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:22.627 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:22.635+0000 7f7d50c16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:46:22.823 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:22.831+0000 7f7d50c16780 -1 Falling back to public interface 2026-02-12T20:46:22.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-12T20:46:22.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:46:22.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-12T20:46:22.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:46:22.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:46:22.835 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:22.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:46:22.836 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:46:22.836 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:22.837 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:46:23.065 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:46:23.417 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:46:23.426+0000 7f7d50c16780 -1 osd.3 0 log_to_monitors true 2026-02-12T20:46:24.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:46:24.067 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:46:24.067 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:46:24.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:46:24.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:46:24.068 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:46:24.295 INFO:tasks.workunit.client.0.trial099.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2085734389,v1:127.0.0.1:6827/2085734389] [v2:127.0.0.1:6828/2085734389,v1:127.0.0.1:6829/2085734389] exists,up bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:46:24.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:46:24.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:46:24.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:46:24.296 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-12T20:46:24.296 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=97624 2026-02-12T20:46:24.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-12T20:46:29.297 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-12T20:46:29.298 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-12T20:46:29.575 INFO:tasks.workunit.client.0.trial099.stderr:pool 'foo' already exists 2026-02-12T20:46:29.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:46:30.585 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-12T20:46:30.604 INFO:tasks.workunit.client.0.trial099.stdout:hints = 1 2026-02-12T20:46:30.604 INFO:tasks.workunit.client.0.trial099.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-12T20:46:30.604 INFO:tasks.workunit.client.0.trial099.stdout:Object prefix: benchmark_data_trial099_98560 2026-02-12T20:46:30.604 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:46:30.604 INFO:tasks.workunit.client.0.trial099.stdout: 0 0 0 0 0 0 - 0 2026-02-12T20:46:31.604 INFO:tasks.workunit.client.0.trial099.stdout: 1 16 11781 11765 45.9535 45.957 0.00140472 0.00135764 2026-02-12T20:46:32.605 INFO:tasks.workunit.client.0.trial099.stdout: 2 16 23679 23663 46.2132 46.4766 0.00110981 0.00135011 2026-02-12T20:46:33.605 INFO:tasks.workunit.client.0.trial099.stdout: 3 16 35452 35436 46.1372 45.9883 0.000979569 0.00135258 2026-02-12T20:46:34.605 INFO:tasks.workunit.client.0.trial099.stdout: 4 16 47313 47297 46.185 46.332 0.000488728 0.00135134 2026-02-12T20:46:35.605 INFO:tasks.workunit.client.0.trial099.stdout: 5 16 59042 59026 46.1106 45.8164 0.00113719 0.00135411 2026-02-12T20:46:36.605 INFO:tasks.workunit.client.0.trial099.stdout: 6 16 70924 70908 46.1606 46.4141 0.00119414 0.00135255 2026-02-12T20:46:37.605 INFO:tasks.workunit.client.0.trial099.stdout: 7 16 82887 82871 46.2417 46.7305 0.00148776 0.00135031 2026-02-12T20:46:38.605 INFO:tasks.workunit.client.0.trial099.stdout: 8 16 94778 94762 46.2672 46.4492 0.00120614 0.00134957 2026-02-12T20:46:39.605 INFO:tasks.workunit.client.0.trial099.stdout: 9 16 106632 106616 46.2709 46.3047 0.00136127 0.00134943 2026-02-12T20:46:40.605 INFO:tasks.workunit.client.0.trial099.stdout: 10 16 118378 118362 46.2318 45.8828 0.00110917 0.00135058 2026-02-12T20:46:41.605 INFO:tasks.workunit.client.0.trial099.stdout: 11 16 130128 130112 46.2011 45.8984 0.00151794 0.00135152 2026-02-12T20:46:42.605 INFO:tasks.workunit.client.0.trial099.stdout: 12 16 140898 140882 45.8566 42.0703 0.00130599 0.00136165 2026-02-12T20:46:43.605 INFO:tasks.workunit.client.0.trial099.stdout: 13 16 151326 151310 45.4624 40.7344 0.00156145 0.00137347 2026-02-12T20:46:44.605 INFO:tasks.workunit.client.0.trial099.stdout: 14 16 161656 161640 45.0971 40.3516 0.00204257 0.00138458 2026-02-12T20:46:45.606 INFO:tasks.workunit.client.0.trial099.stdout: 15 16 171660 171644 44.6956 39.0781 0.00154344 0.00139705 2026-02-12T20:46:46.606 INFO:tasks.workunit.client.0.trial099.stdout: 16 16 178274 178258 43.5168 25.8359 0.0894405 0.00142978 2026-02-12T20:46:47.606 INFO:tasks.workunit.client.0.trial099.stdout: 17 16 178372 178356 40.9795 0.382812 0.12554 0.00151913 2026-02-12T20:46:48.606 INFO:tasks.workunit.client.0.trial099.stdout: 18 16 178474 178458 38.725 0.398438 0.202461 0.00160205 2026-02-12T20:46:49.606 INFO:tasks.workunit.client.0.trial099.stdout: 19 16 178589 178573 36.7105 0.449219 0.202932 0.00168865 2026-02-12T20:46:50.606 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:46:50.615855+0000 min lat: 0.000433394 max lat: 0.225784 avg lat: 0.00178257 2026-02-12T20:46:50.606 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:46:50.606 INFO:tasks.workunit.client.0.trial099.stdout: 20 16 179418 179402 35.0369 3.23828 0.00129143 0.00178257 2026-02-12T20:46:51.606 INFO:tasks.workunit.client.0.trial099.stdout: 21 16 189428 189412 35.2303 39.1016 0.00236402 0.00177274 2026-02-12T20:46:52.606 INFO:tasks.workunit.client.0.trial099.stdout: 22 16 199648 199632 35.4434 39.9219 0.00154259 0.00176212 2026-02-12T20:46:53.606 INFO:tasks.workunit.client.0.trial099.stdout: 23 15 209752 209737 35.6184 39.4727 0.0011676 0.00175344 2026-02-12T20:46:54.607 INFO:tasks.workunit.client.0.trial099.stdout: 24 16 219761 219745 35.7631 39.0938 0.00100322 0.00174632 2026-02-12T20:46:55.607 INFO:tasks.workunit.client.0.trial099.stdout: 25 16 229821 229805 35.9043 39.2969 0.00123198 0.00173945 2026-02-12T20:46:56.607 INFO:tasks.workunit.client.0.trial099.stdout: 26 16 233678 233662 35.1028 15.0664 0.165824 0.00177553 2026-02-12T20:46:57.607 INFO:tasks.workunit.client.0.trial099.stdout: 27 16 233777 233761 33.8171 0.386719 0.219332 0.00184163 2026-02-12T20:46:58.607 INFO:tasks.workunit.client.0.trial099.stdout: 28 16 238552 238536 33.2754 18.6523 0.00123333 0.00187697 2026-02-12T20:46:59.607 INFO:tasks.workunit.client.0.trial099.stdout: 29 16 248620 248604 33.484 39.3281 0.00118354 0.00186529 2026-02-12T20:47:00.607 INFO:tasks.workunit.client.0.trial099.stdout:Total time run: 30.0009 2026-02-12T20:47:00.607 INFO:tasks.workunit.client.0.trial099.stdout:Total writes made: 258679 2026-02-12T20:47:00.607 INFO:tasks.workunit.client.0.trial099.stdout:Write size: 4096 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Object size: 4096 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Bandwidth (MB/sec): 33.6812 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Bandwidth: 17.012 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Max bandwidth (MB/sec): 46.7305 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Min bandwidth (MB/sec): 0.382812 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Average IOPS: 8622 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Stddev IOPS: 4355.08 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Max IOPS: 11963 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Min IOPS: 98 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Average Latency(s): 0.00185438 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Latency(s): 0.00793726 2026-02-12T20:47:00.608 INFO:tasks.workunit.client.0.trial099.stdout:Max latency(s): 0.226453 2026-02-12T20:47:00.609 INFO:tasks.workunit.client.0.trial099.stdout:Min latency(s): 0.000433394 2026-02-12T20:47:00.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-12T20:47:00.610 INFO:tasks.workunit.client.0.trial099.stdout:after bench 2026-02-12T20:47:00.610 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 90999 2026-02-12T20:47:00.610 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-12T20:47:01.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 90999 2026-02-12T20:47:01.612 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (90999) - No such process 2026-02-12T20:47:01.612 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-12T20:47:01.836 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:47:01.843 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 93317 2026-02-12T20:47:01.844 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-12T20:47:02.845 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 93317 2026-02-12T20:47:02.846 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (93317) - No such process 2026-02-12T20:47:02.846 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-12T20:47:03.071 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:47:03.078 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 95439 2026-02-12T20:47:03.078 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-12T20:47:04.079 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 95439 2026-02-12T20:47:04.079 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (95439) - No such process 2026-02-12T20:47:04.080 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-12T20:47:04.303 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:47:04.310 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 97624 2026-02-12T20:47:04.310 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-12T20:47:05.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 97624 2026-02-12T20:47:05.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (97624) - No such process 2026-02-12T20:47:05.312 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-12T20:47:05.586 INFO:tasks.workunit.client.0.trial099.stderr:osd.3 is already down. 2026-02-12T20:47:05.593 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:47:08.259 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:08.280 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:47:10.924 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:10.943 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:47:13.593 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:13.617 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:47:16.289 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:16.308 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-12T20:47:16.310 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-12T20:47:16.320 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:18.494 INFO:tasks.workunit.client.0.trial099.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-12T20:47:18.495 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-12T20:47:18.495 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0x100000000(4 GiB) : using 0xaf687000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaf687000(2.7 GiB) 2026-02-12T20:47:18.495 INFO:tasks.workunit.client.0.trial099.stdout:Expanding DB/WAL... 2026-02-12T20:47:18.495 INFO:tasks.workunit.client.0.trial099.stdout:0 : nothing to do, skipped 2026-02-12T20:47:18.495 INFO:tasks.workunit.client.0.trial099.stdout:1 : nothing to do, skipped 2026-02-12T20:47:18.495 INFO:tasks.workunit.client.0.trial099.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-12T20:47:18.496 INFO:tasks.workunit.client.0.trial099.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-12T20:47:20.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-12T20:47:20.880 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-12T20:47:20.891 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26f6a9000(9.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x26f6a9000(9.7 GiB) 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:Expanding DB/WAL... 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:0 : nothing to do, skipped 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:1 : nothing to do, skipped 2026-02-12T20:47:23.040 INFO:tasks.workunit.client.0.trial099.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-12T20:47:23.041 INFO:tasks.workunit.client.0.trial099.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-12T20:47:26.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-12T20:47:26.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-12T20:47:26.340 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:28.503 INFO:tasks.workunit.client.0.trial099.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-12T20:47:28.503 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-12T20:47:28.503 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xaf58a000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaf58a000(2.7 GiB) 2026-02-12T20:47:28.504 INFO:tasks.workunit.client.0.trial099.stdout:Expanding DB/WAL... 2026-02-12T20:47:28.504 INFO:tasks.workunit.client.0.trial099.stdout:0 : nothing to do, skipped 2026-02-12T20:47:28.504 INFO:tasks.workunit.client.0.trial099.stdout:1 : nothing to do, skipped 2026-02-12T20:47:28.504 INFO:tasks.workunit.client.0.trial099.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-12T20:47:28.504 INFO:tasks.workunit.client.0.trial099.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-12T20:47:30.897 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-12T20:47:30.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-12T20:47:30.909 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:33.116 INFO:tasks.workunit.client.0.trial099.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-12T20:47:33.116 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-12T20:47:33.117 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xaf4b4000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaf4b4000(2.7 GiB) 2026-02-12T20:47:33.117 INFO:tasks.workunit.client.0.trial099.stdout:Expanding DB/WAL... 2026-02-12T20:47:33.117 INFO:tasks.workunit.client.0.trial099.stdout:0 : nothing to do, skipped 2026-02-12T20:47:33.117 INFO:tasks.workunit.client.0.trial099.stdout:1 : nothing to do, skipped 2026-02-12T20:47:33.117 INFO:tasks.workunit.client.0.trial099.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-12T20:47:33.117 INFO:tasks.workunit.client.0.trial099.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-12T20:47:35.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:47:36.169 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:36.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:47:36.824 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:36.846 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:47:37.485 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:37.507 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:47:38.148 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:38.173 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-12T20:47:38.183 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:38.277 INFO:tasks.workunit.client.0.trial099.stdout:0 : device size 0x20000000(512 MiB) : using 0x1900000(25 MiB) 2026-02-12T20:47:38.278 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0x4100000(65 MiB) 2026-02-12T20:47:38.278 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0x100000000(4 GiB) : using 0x2f687000(759 MiB) : bluefs used 0x0(0 B) : non-bluefs used 0x2f687000(759 MiB) 2026-02-12T20:47:38.348 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-12T20:47:38.358 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:38.635 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-12T20:47:38.640 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:47:39.232 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:39.254 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-12T20:47:39.265 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:39.552 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-12T20:47:39.555 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:47:40.156 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:40.184 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-12T20:47:40.194 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:40.555 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-12T20:47:40.556 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-12T20:47:40.562 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:47:41.132 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:41.154 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-12T20:47:41.165 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:41.214 INFO:tasks.workunit.client.0.trial099.stderr:Migrate to WAL device isn't supported. 2026-02-12T20:47:41.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-12T20:47:41.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:47:41.844 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:41.870 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-12T20:47:41.881 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:42.135 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-12T20:47:42.139 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:47:42.746 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:42.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-12T20:47:42.778 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:47:42.963 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:47:43.556 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:47:43.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:47:43.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:47:43.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:47:43.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:47:43.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:47:43.582 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:47:43.583 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:47:43.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:47:43.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:47:43.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:47:43.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:47:43.584 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:47:43.584 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:47:43.585 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:47:43.585 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-12T20:47:43.585 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:47:43.585 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:47:43.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:47:43.586 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:47:43.595 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:43.603+0000 7fc26a5e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:43.596 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:43.605+0000 7fc26a5e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:43.597 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:43.606+0000 7fc26a5e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:43.761 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:43.769+0000 7fc26a5e1780 -1 Falling back to public interface 2026-02-12T20:47:43.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:47:43.810 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:47:43.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:43.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:47:44.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:44.960 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:44.968+0000 7fc26a5e1780 -1 osd.0 24 log_to_monitors true 2026-02-12T20:47:45.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:45.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:45.036 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:47:45.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:47:45.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:45.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:47:45.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:46.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:46.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:46.268 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:47:46.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:47:46.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:46.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:47:46.491 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 32 up_thru 32 down_at 24 last_clean_interval [5,24) [v2:127.0.0.1:6800/3292969270,v1:127.0.0.1:6801/3292969270] [v2:127.0.0.1:6802/3292969270,v1:127.0.0.1:6803/3292969270] exists,up 2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:47:46.492 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:47:46.492 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:47:46.492 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:47:46.492 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:47:46.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=109222 2026-02-12T20:47:46.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-12T20:47:46.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:47:46.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:47:46.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:47:46.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:47:46.494 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:47:46.495 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:47:46.496 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:47:46.496 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-12T20:47:46.497 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:47:46.497 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:47:46.497 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:47:46.497 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:47:46.510 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:46.519+0000 7f304a82c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:46.511 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:46.520+0000 7f304a82c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:46.512 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:46.521+0000 7f304a82c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:46.671 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:46.679+0000 7f304a82c780 -1 Falling back to public interface 2026-02-12T20:47:46.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:47:46.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:47:46.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:47:46.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:47:46.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:47:46.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:46.721 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:47:46.721 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:47:46.722 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:46.722 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:47:46.945 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:47.871 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:47.879+0000 7f304a82c780 -1 osd.1 25 log_to_monitors true 2026-02-12T20:47:47.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:47.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:47.947 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:47:47.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:47:47.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:47.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:47:48.179 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:49.180 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:47:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:47:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:49.180 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:47:49.413 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 35 up_thru 35 down_at 26 last_clean_interval [10,25) [v2:127.0.0.1:6810/2321834820,v1:127.0.0.1:6811/2321834820] [v2:127.0.0.1:6812/2321834820,v1:127.0.0.1:6813/2321834820] exists,up aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:47:49.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:47:49.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:47:49.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:47:49.414 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=110358 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:47:49.418 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:47:49.419 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:47:49.420 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-12T20:47:49.421 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:47:49.421 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:47:49.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:47:49.422 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-12T20:47:49.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:47:49.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:47:49.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:47:49.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:47:49.432 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:49.440+0000 7f1be120a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:49.433 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:49.442+0000 7f1be120a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:49.434 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:49.443+0000 7f1be120a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:49.573 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:49.581+0000 7f1be120a780 -1 Falling back to public interface 2026-02-12T20:47:49.646 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:47:49.647 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:47:49.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:49.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:47:49.869 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:50.783 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:50.792+0000 7f1be120a780 -1 osd.2 27 log_to_monitors true 2026-02-12T20:47:50.870 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:50.870 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:50.871 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:47:50.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:47:50.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:50.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:47:51.102 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:52.103 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:52.104 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:52.104 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:47:52.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:47:52.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:52.105 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:47:52.329 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 39 up_thru 39 down_at 28 last_clean_interval [14,27) [v2:127.0.0.1:6818/4294324856,v1:127.0.0.1:6819/4294324856] [v2:127.0.0.1:6820/4294324856,v1:127.0.0.1:6821/4294324856] exists,up 103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:47:52.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:47:52.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:47:52.330 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:47:52.330 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=111298 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:47:52.331 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:47:52.332 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stdout:start osd.3 2026-02-12T20:47:52.333 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:47:52.334 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-12T20:47:52.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-12T20:47:52.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:47:52.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:47:52.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:47:52.347 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:52.356+0000 7f2314236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:52.348 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:52.357+0000 7f2314236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:52.349 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:52.358+0000 7f2314236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:47:52.517 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:52.526+0000 7f2314236780 -1 Falling back to public interface 2026-02-12T20:47:52.558 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:47:52.559 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:47:52.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:52.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:47:52.785 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:53.696 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:47:53.704+0000 7f2314236780 -1 osd.3 29 log_to_monitors true 2026-02-12T20:47:53.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:53.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:53.787 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:47:53.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:47:53.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:53.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:47:54.013 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:47:55.014 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:47:55.014 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:47:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:47:55.015 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:47:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:47:55.015 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:47:55.239 INFO:tasks.workunit.client.0.trial099.stdout:osd.3 up in weight 1 up_from 42 up_thru 42 down_at 30 last_clean_interval [19,29) [v2:127.0.0.1:6826/1211966820,v1:127.0.0.1:6827/1211966820] [v2:127.0.0.1:6828/1211966820,v1:127.0.0.1:6829/1211966820] exists,up bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:47:55.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:47:55.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:47:55.241 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:47:55.241 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=112233 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:47:55.243 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:47:55.244 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:47:55.244 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:47:55.244 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:47:55.323 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:47:55.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:47:55.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:47:55.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:47:55.324 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:47:55.324 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:47:55.547 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:47:55.547 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:47:55.548 INFO:tasks.workunit.client.0.trial099.stderr:2 2026-02-12T20:47:55.548 INFO:tasks.workunit.client.0.trial099.stderr:3' 2026-02-12T20:47:55.548 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:47:55.548 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:47:55.548 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:47:55.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953477 2026-02-12T20:47:55.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953477 2026-02-12T20:47:55.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-137438953477' 2026-02-12T20:47:55.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:47:55.612 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:47:55.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-12T20:47:55.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-12T20:47:55.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-137438953477 1-150323855364' 2026-02-12T20:47:55.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:47:55.678 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:47:55.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-12T20:47:55.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-12T20:47:55.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-137438953477 1-150323855364 2-167503724547' 2026-02-12T20:47:55.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:47:55.744 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-12T20:47:55.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626435 2026-02-12T20:47:55.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626435 2026-02-12T20:47:55.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-137438953477 1-150323855364 2-167503724547 3-180388626435' 2026-02-12T20:47:55.808 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:47:55.809 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-137438953477 2026-02-12T20:47:55.809 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:47:55.809 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:47:55.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-137438953477 2026-02-12T20:47:55.810 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:47:55.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953477 2026-02-12T20:47:55.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 137438953477' 2026-02-12T20:47:55.812 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 137438953477 2026-02-12T20:47:55.812 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:47:56.033 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953477 -lt 137438953477 2026-02-12T20:47:56.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:47:56.034 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-150323855364 2026-02-12T20:47:56.034 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:47:56.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:47:56.036 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-150323855364 2026-02-12T20:47:56.036 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:47:56.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855364 2026-02-12T20:47:56.037 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 150323855364 2026-02-12T20:47:56.038 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 150323855364' 2026-02-12T20:47:56.038 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:47:56.262 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855364 2026-02-12T20:47:56.262 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:47:57.263 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:47:57.263 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:47:57.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855364 2026-02-12T20:47:57.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:47:58.490 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:47:58.490 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:47:58.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-12T20:47:58.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:47:58.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724547 2026-02-12T20:47:58.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:47:58.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:47:58.718 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724547 2026-02-12T20:47:58.719 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:47:58.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724547 2026-02-12T20:47:58.720 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724547' 2026-02-12T20:47:58.720 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 167503724547 2026-02-12T20:47:58.720 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:47:58.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724548 -lt 167503724547 2026-02-12T20:47:58.947 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:47:58.948 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-180388626435 2026-02-12T20:47:58.948 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:47:58.948 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-12T20:47:58.949 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-180388626435 2026-02-12T20:47:58.949 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:47:58.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626435 2026-02-12T20:47:58.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 180388626435' 2026-02-12T20:47:58.951 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.3 seq 180388626435 2026-02-12T20:47:58.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-12T20:47:59.185 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-12T20:47:59.186 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:47:59.186 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:47:59.186 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:47:59.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-12T20:47:59.503 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:47:59.503 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:47:59.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:47:59.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:47:59.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:47:59.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:47:59.504 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:47:59.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-12T20:47:59.731 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:47:59.731 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:47:59.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:48:00.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-12T20:48:00.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:48:00.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:48:00.050 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-12T20:48:00.067 INFO:tasks.workunit.client.0.trial099.stdout:hints = 1 2026-02-12T20:48:00.068 INFO:tasks.workunit.client.0.trial099.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-12T20:48:00.068 INFO:tasks.workunit.client.0.trial099.stdout:Object prefix: benchmark_data_trial099_113573 2026-02-12T20:48:00.068 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:48:00.068 INFO:tasks.workunit.client.0.trial099.stdout: 0 0 0 0 0 0 - 0 2026-02-12T20:48:01.067 INFO:tasks.workunit.client.0.trial099.stdout: 1 16 12200 12184 47.5864 47.5938 0.00129452 0.00131095 2026-02-12T20:48:02.067 INFO:tasks.workunit.client.0.trial099.stdout: 2 16 24634 24618 48.0764 48.5703 0.00117081 0.00129838 2026-02-12T20:48:03.068 INFO:tasks.workunit.client.0.trial099.stdout: 3 16 36669 36653 47.7192 47.0117 0.00112641 0.0013082 2026-02-12T20:48:04.068 INFO:tasks.workunit.client.0.trial099.stdout: 4 16 48965 48949 47.7963 48.0312 0.000777955 0.00130611 2026-02-12T20:48:05.068 INFO:tasks.workunit.client.0.trial099.stdout: 5 16 61135 61119 47.7441 47.5391 0.00127347 0.00130762 2026-02-12T20:48:06.068 INFO:tasks.workunit.client.0.trial099.stdout: 6 16 73015 72999 47.5205 46.4062 0.00108522 0.00131377 2026-02-12T20:48:07.068 INFO:tasks.workunit.client.0.trial099.stdout: 7 16 84726 84710 47.2664 45.7461 0.00128819 0.00132093 2026-02-12T20:48:08.068 INFO:tasks.workunit.client.0.trial099.stdout: 8 16 96274 96258 46.9964 45.1094 0.00127579 0.00132855 2026-02-12T20:48:09.068 INFO:tasks.workunit.client.0.trial099.stdout: 9 16 107755 107739 46.7572 44.8477 0.00274535 0.00133522 2026-02-12T20:48:10.068 INFO:tasks.workunit.client.0.trial099.stdout: 10 16 118746 118730 46.3745 42.9336 0.00213258 0.00134639 2026-02-12T20:48:11.068 INFO:tasks.workunit.client.0.trial099.stdout: 11 16 129966 129950 46.1427 43.8281 0.00122882 0.00135316 2026-02-12T20:48:12.069 INFO:tasks.workunit.client.0.trial099.stdout: 12 16 140934 140918 45.8676 42.8438 0.00139982 0.00136129 2026-02-12T20:48:13.069 INFO:tasks.workunit.client.0.trial099.stdout: 13 16 151496 151480 45.5127 41.2578 0.00183291 0.00137192 2026-02-12T20:48:14.068 INFO:tasks.workunit.client.0.trial099.stdout: 14 16 161762 161746 45.126 40.1016 0.00129283 0.00138367 2026-02-12T20:48:15.069 INFO:tasks.workunit.client.0.trial099.stdout: 15 16 172150 172134 44.8226 40.5781 0.00124228 0.00139306 2026-02-12T20:48:16.069 INFO:tasks.workunit.client.0.trial099.stdout: 16 16 182562 182546 44.563 40.6719 0.00260889 0.00140121 2026-02-12T20:48:17.069 INFO:tasks.workunit.client.0.trial099.stdout: 17 16 192901 192885 44.3171 40.3867 0.00132941 0.00140898 2026-02-12T20:48:18.069 INFO:tasks.workunit.client.0.trial099.stdout: 18 16 196455 196439 42.6263 13.8828 0.114291 0.00146222 2026-02-12T20:48:19.069 INFO:tasks.workunit.client.0.trial099.stdout: 19 16 196595 196579 40.4116 0.546875 0.0773005 0.00154048 2026-02-12T20:48:20.069 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:48:20.078809+0000 min lat: 0.000408819 max lat: 0.208248 avg lat: 0.00161714 2026-02-12T20:48:20.070 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:48:20.070 INFO:tasks.workunit.client.0.trial099.stdout: 20 16 196698 196682 38.4112 0.402344 0.114423 0.00161714 2026-02-12T20:48:21.069 INFO:tasks.workunit.client.0.trial099.stdout: 21 16 196807 196791 36.6024 0.425781 0.185131 0.00169822 2026-02-12T20:48:22.069 INFO:tasks.workunit.client.0.trial099.stdout: 22 16 196919 196903 34.9585 0.4375 0.0741341 0.00177963 2026-02-12T20:48:23.069 INFO:tasks.workunit.client.0.trial099.stdout: 23 16 207469 207453 35.2302 41.2109 0.00144049 0.00177272 2026-02-12T20:48:24.069 INFO:tasks.workunit.client.0.trial099.stdout: 24 16 217950 217934 35.4681 40.9414 0.00140968 0.00176086 2026-02-12T20:48:25.070 INFO:tasks.workunit.client.0.trial099.stdout: 25 16 228223 228207 35.6544 40.1289 0.00117045 0.00175165 2026-02-12T20:48:26.070 INFO:tasks.workunit.client.0.trial099.stdout: 26 16 238661 238645 35.8511 40.7734 0.00126957 0.00174202 2026-02-12T20:48:27.070 INFO:tasks.workunit.client.0.trial099.stdout: 27 16 248878 248862 36.0013 39.9102 0.00103496 0.00173476 2026-02-12T20:48:28.070 INFO:tasks.workunit.client.0.trial099.stdout: 28 16 249466 249450 34.7976 2.29688 0.142548 0.00178889 2026-02-12T20:48:29.070 INFO:tasks.workunit.client.0.trial099.stdout: 29 16 249552 249536 33.6093 0.335938 0.137117 0.00185335 2026-02-12T20:48:30.070 INFO:tasks.workunit.client.0.trial099.stdout:Total time run: 30.0012 2026-02-12T20:48:30.070 INFO:tasks.workunit.client.0.trial099.stdout:Total writes made: 254918 2026-02-12T20:48:30.070 INFO:tasks.workunit.client.0.trial099.stdout:Write size: 4096 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Object size: 4096 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Bandwidth (MB/sec): 33.1912 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Bandwidth: 18.1378 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Max bandwidth (MB/sec): 48.5703 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Min bandwidth (MB/sec): 0.335938 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Average IOPS: 8496 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Stddev IOPS: 4643.29 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Max IOPS: 12434 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Min IOPS: 86 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Average Latency(s): 0.00188175 2026-02-12T20:48:30.071 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Latency(s): 0.00799891 2026-02-12T20:48:30.072 INFO:tasks.workunit.client.0.trial099.stdout:Max latency(s): 0.247363 2026-02-12T20:48:30.072 INFO:tasks.workunit.client.0.trial099.stdout:Min latency(s): 0.000408819 2026-02-12T20:48:30.073 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 109222 2026-02-12T20:48:30.073 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-12T20:48:31.074 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 109222 2026-02-12T20:48:31.074 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (109222) - No such process 2026-02-12T20:48:31.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-12T20:48:31.305 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:48:31.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 110358 2026-02-12T20:48:31.313 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-12T20:48:32.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 110358 2026-02-12T20:48:32.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (110358) - No such process 2026-02-12T20:48:32.314 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-12T20:48:32.536 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:48:32.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 111298 2026-02-12T20:48:32.543 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-12T20:48:33.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 111298 2026-02-12T20:48:33.545 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (111298) - No such process 2026-02-12T20:48:33.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-12T20:48:33.773 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:48:33.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 112233 2026-02-12T20:48:33.780 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-12T20:48:34.781 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 112233 2026-02-12T20:48:34.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (112233) - No such process 2026-02-12T20:48:34.782 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-12T20:48:35.056 INFO:tasks.workunit.client.0.trial099.stderr:osd.3 is already down. 2026-02-12T20:48:35.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:48:37.965 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:48:38.006 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-12T20:48:38.229 INFO:tasks.workunit.client.0.trial099.stderr:512+0 records in 2026-02-12T20:48:38.229 INFO:tasks.workunit.client.0.trial099.stderr:512+0 records out 2026-02-12T20:48:38.229 INFO:tasks.workunit.client.0.trial099.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.221105 s, 2.4 GB/s 2026-02-12T20:48:38.229 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-12T20:48:38.240 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:48:40.813 INFO:tasks.workunit.client.0.trial099.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-12T20:48:40.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:48:43.785 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:48:43.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:48:46.868 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:48:46.907 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-12T20:48:47.336 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records in 2026-02-12T20:48:47.336 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records out 2026-02-12T20:48:47.336 INFO:tasks.workunit.client.0.trial099.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.426945 s, 2.5 GB/s 2026-02-12T20:48:47.336 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-12T20:48:47.347 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:48:50.597 INFO:tasks.workunit.client.0.trial099.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-12T20:48:50.613 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-12T20:48:50.623 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:48:53.020 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:48:56.106 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:48:56.141 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:48:59.080 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:48:59.116 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-12T20:48:59.126 INFO:tasks.workunit.client.0.trial099.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-12T20:48:59.126 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:49:01.333 INFO:tasks.workunit.client.0.trial099.stdout:DB device added 2026-02-12T20:49:01.347 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-12T20:49:01.358 INFO:tasks.workunit.client.0.trial099.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-12T20:49:01.358 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:49:03.608 INFO:tasks.workunit.client.0.trial099.stdout:WAL device added 2026-02-12T20:49:03.625 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-12T20:49:03.635 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:49:06.508 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:49:09.500 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:49:09.531 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:49:12.403 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:49:12.437 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-12T20:49:12.447 INFO:tasks.workunit.client.0.trial099.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-12T20:49:12.447 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:49:14.619 INFO:tasks.workunit.client.0.trial099.stdout:WAL device added 2026-02-12T20:49:14.633 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-12T20:49:14.642 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:49:17.416 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-12T20:49:17.436 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:49:20.229 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:49:20.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:49:20.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:49:20.267 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:49:20.268 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:49:20.269 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:49:20.270 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:49:20.270 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-12T20:49:20.270 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:49:20.270 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:49:20.270 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:49:20.270 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:49:20.279 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:20.286+0000 7fa47e087780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:20.280 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:20.288+0000 7fa47e087780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:20.281 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:20.288+0000 7fa47e087780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:20.459 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:20.466+0000 7fa47e087780 -1 Falling back to public interface 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:20.499 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:49:20.500 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:49:20.500 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:20.500 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:49:20.725 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:21.726 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:21.726 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:21.727 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:49:21.728 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:49:21.728 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:21.728 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:49:21.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:22.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:22.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:22.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:49:22.954 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:49:22.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:22.955 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:49:23.183 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:24.185 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:24.185 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:24.185 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:49:24.186 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:49:24.186 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:24.186 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:49:24.413 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:25.415 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:25.415 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:25.415 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:49:25.416 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:49:25.416 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:25.416 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:49:25.647 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:26.141 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:26.149+0000 7fa47e087780 -1 osd.0 44 log_to_monitors true 2026-02-12T20:49:26.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:26.648 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:26.648 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:49:26.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:49:26.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:26.649 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:49:26.876 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 52 up_thru 52 down_at 44 last_clean_interval [32,44) [v2:127.0.0.1:6800/3632551326,v1:127.0.0.1:6801/3632551326] [v2:127.0.0.1:6802/3632551326,v1:127.0.0.1:6803/3632551326] exists,up 2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:49:26.883 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:49:26.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:49:26.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:49:26.884 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:49:26.884 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=119724 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:49:26.885 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:49:26.886 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:49:26.887 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-12T20:49:26.888 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:49:26.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:49:26.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:49:26.889 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-12T20:49:26.889 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:49:26.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:49:26.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:49:26.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:49:26.894 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:26.902+0000 7fc0f7255780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:26.896 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:26.903+0000 7fc0f7255780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:26.896 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:26.904+0000 7fc0f7255780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:27.073 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:27.080+0000 7fc0f7255780 -1 Falling back to public interface 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:27.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:49:27.110 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:49:27.110 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:27.110 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:27.334 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:28.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:28.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:28.335 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:49:28.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:49:28.335 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:28.336 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:28.559 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:29.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:29.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:29.560 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:49:29.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:49:29.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:29.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:29.794 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:30.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:30.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:30.796 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:49:30.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:49:30.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:30.796 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:31.026 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:32.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:32.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:32.027 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:49:32.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:49:32.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:32.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:32.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:33.010 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:33.019+0000 7fc0f7255780 -1 osd.1 45 log_to_monitors true 2026-02-12T20:49:33.259 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:33.259 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:33.259 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:49:33.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:49:33.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:33.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:33.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:34.495 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:34.496 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:34.496 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-12T20:49:34.496 INFO:tasks.workunit.client.0.trial099.stdout:6 2026-02-12T20:49:34.497 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:34.497 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:49:34.726 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 46 last_clean_interval [35,45) [v2:127.0.0.1:6810/3136990650,v1:127.0.0.1:6811/3136990650] [v2:127.0.0.1:6812/3136990650,v1:127.0.0.1:6813/3136990650] exists,up aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:49:34.726 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:49:34.726 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:49:34.727 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:49:34.727 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-12T20:49:34.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=120744 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:49:34.731 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:49:34.732 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:49:34.733 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:49:34.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:49:34.734 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-12T20:49:34.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:49:34.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:49:34.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:49:34.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:49:34.743 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:34.751+0000 7efcace29780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:34.744 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:34.753+0000 7efcace29780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:34.745 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:34.754+0000 7efcace29780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:34.912 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:34.921+0000 7efcace29780 -1 Falling back to public interface 2026-02-12T20:49:34.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:49:34.966 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:49:34.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:49:34.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:49:34.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:49:34.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:34.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:49:34.968 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:49:34.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:34.969 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:49:35.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:36.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:36.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:36.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:49:36.196 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:49:36.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:36.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:49:36.426 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:37.428 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:37.428 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:37.428 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:49:37.428 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:49:37.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:37.429 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:49:37.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:38.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:38.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:38.665 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:49:38.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:49:38.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:38.665 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:49:38.898 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:39.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:39.899 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:39.899 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:49:39.900 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:49:39.900 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:39.900 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:49:40.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:40.697 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:40.705+0000 7efcace29780 -1 osd.2 47 log_to_monitors true 2026-02-12T20:49:41.131 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:41.131 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:41.132 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:49:41.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:49:41.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:41.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:49:41.361 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 58 up_thru 58 down_at 48 last_clean_interval [39,47) [v2:127.0.0.1:6818/1622421067,v1:127.0.0.1:6819/1622421067] [v2:127.0.0.1:6820/1622421067,v1:127.0.0.1:6821/1622421067] exists,up 103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:49:41.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:49:41.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:49:41.361 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:49:41.362 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=121790 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:49:41.365 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:49:41.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-12T20:49:41.367 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-12T20:49:41.367 INFO:tasks.workunit.client.0.trial099.stdout:start osd.3 2026-02-12T20:49:41.367 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:49:41.367 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-12T20:49:41.367 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-12T20:49:41.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:49:41.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:49:41.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:49:41.378 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:41.387+0000 7fc1e2e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:41.380 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:41.388+0000 7fc1e2e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:41.381 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:41.389+0000 7fc1e2e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:49:41.542 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:41.550+0000 7fc1e2e0f780 -1 Falling back to public interface 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:49:41.595 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:49:41.596 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:41.596 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:49:41.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:42.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:42.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:42.819 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:49:42.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:49:42.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:42.820 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:49:43.052 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:44.053 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:44.053 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:44.054 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:49:44.054 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:49:44.054 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:44.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:49:44.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:45.280 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:45.280 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:45.281 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:49:45.281 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:49:45.282 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:45.282 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:49:45.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:46.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:46.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:46.513 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:49:46.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:49:46.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:46.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:49:46.742 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:49:47.153 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:49:47.162+0000 7fc1e2e0f780 -1 osd.3 49 log_to_monitors true 2026-02-12T20:49:47.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:49:47.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:49:47.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:49:47.745 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:49:47.745 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:49:47.745 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:49:47.969 INFO:tasks.workunit.client.0.trial099.stdout:osd.3 up in weight 1 up_from 61 up_thru 61 down_at 50 last_clean_interval [42,49) [v2:127.0.0.1:6826/656059703,v1:127.0.0.1:6827/656059703] [v2:127.0.0.1:6828/656059703,v1:127.0.0.1:6829/656059703] exists,up bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:49:47.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:49:47.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:49:47.970 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:49:47.970 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-12T20:49:47.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=122810 2026-02-12T20:49:47.971 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-12T20:49:47.988 INFO:tasks.workunit.client.0.trial099.stdout:hints = 1 2026-02-12T20:49:47.988 INFO:tasks.workunit.client.0.trial099.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-12T20:49:47.988 INFO:tasks.workunit.client.0.trial099.stdout:Object prefix: benchmark_data_trial099_123811 2026-02-12T20:49:47.988 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:49:47.989 INFO:tasks.workunit.client.0.trial099.stdout: 0 0 0 0 0 0 - 0 2026-02-12T20:49:48.988 INFO:tasks.workunit.client.0.trial099.stdout: 1 16 11725 11709 45.7348 45.7383 0.00108602 0.0013645 2026-02-12T20:49:49.988 INFO:tasks.workunit.client.0.trial099.stdout: 2 16 23150 23134 45.18 44.6289 0.00144593 0.00138152 2026-02-12T20:49:50.988 INFO:tasks.workunit.client.0.trial099.stdout: 3 16 34569 34553 44.9874 44.6055 0.000830472 0.0013873 2026-02-12T20:49:51.988 INFO:tasks.workunit.client.0.trial099.stdout: 4 16 45899 45883 44.8041 44.2578 0.00100459 0.00139344 2026-02-12T20:49:52.988 INFO:tasks.workunit.client.0.trial099.stdout: 5 16 57199 57183 44.6707 44.1406 0.00140535 0.00139768 2026-02-12T20:49:53.988 INFO:tasks.workunit.client.0.trial099.stdout: 6 16 64934 64918 42.2611 30.2148 0.00107353 0.00147748 2026-02-12T20:49:54.988 INFO:tasks.workunit.client.0.trial099.stdout: 7 16 76155 76139 42.485 43.832 0.00108818 0.0014697 2026-02-12T20:49:55.988 INFO:tasks.workunit.client.0.trial099.stdout: 8 16 87218 87202 42.5758 43.2148 0.00167831 0.00146659 2026-02-12T20:49:56.989 INFO:tasks.workunit.client.0.trial099.stdout: 9 16 98500 98484 42.7415 44.0703 0.00111894 0.00146092 2026-02-12T20:49:57.989 INFO:tasks.workunit.client.0.trial099.stdout: 10 16 109552 109536 42.7842 43.1719 0.00284083 0.00145934 2026-02-12T20:49:58.989 INFO:tasks.workunit.client.0.trial099.stdout: 11 16 118201 118185 41.9659 33.7852 0.0793489 0.00148042 2026-02-12T20:49:59.989 INFO:tasks.workunit.client.0.trial099.stdout: 12 16 118323 118307 38.5085 0.476562 0.0572872 0.00161039 2026-02-12T20:50:00.989 INFO:tasks.workunit.client.0.trial099.stdout: 13 16 126543 126527 38.0161 32.1094 0.0012929 0.00164266 2026-02-12T20:50:01.989 INFO:tasks.workunit.client.0.trial099.stdout: 14 16 137501 137485 38.3579 42.8047 0.00129892 0.00162806 2026-02-12T20:50:02.989 INFO:tasks.workunit.client.0.trial099.stdout: 15 16 148473 148457 38.6578 42.8594 0.00167329 0.00161544 2026-02-12T20:50:03.989 INFO:tasks.workunit.client.0.trial099.stdout: 16 16 159055 159039 38.825 41.3359 0.000928364 0.00160844 2026-02-12T20:50:04.989 INFO:tasks.workunit.client.0.trial099.stdout: 17 16 169519 169503 38.9454 40.875 0.00126599 0.00160346 2026-02-12T20:50:05.989 INFO:tasks.workunit.client.0.trial099.stdout: 18 16 174177 174161 37.7925 18.1953 0.111372 0.00165045 2026-02-12T20:50:06.989 INFO:tasks.workunit.client.0.trial099.stdout: 19 16 179595 179579 36.9173 21.1641 0.00156404 0.00169164 2026-02-12T20:50:07.989 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:50:07.998893+0000 min lat: 0.000487054 max lat: 0.177381 avg lat: 0.00168201 2026-02-12T20:50:07.990 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:50:07.990 INFO:tasks.workunit.client.0.trial099.stdout: 20 16 190128 190112 37.1285 41.1445 0.00106548 0.00168201 2026-02-12T20:50:08.989 INFO:tasks.workunit.client.0.trial099.stdout: 21 16 200688 200672 37.3246 41.25 0.00116548 0.00167315 2026-02-12T20:50:09.989 INFO:tasks.workunit.client.0.trial099.stdout: 22 16 211314 211298 37.5146 41.5078 0.0011523 0.0016647 2026-02-12T20:50:10.989 INFO:tasks.workunit.client.0.trial099.stdout: 23 16 221731 221715 37.6526 40.6914 0.00188854 0.00165859 2026-02-12T20:50:11.990 INFO:tasks.workunit.client.0.trial099.stdout: 24 16 227914 227898 37.09 24.1523 0.1143 0.00167809 2026-02-12T20:50:12.990 INFO:tasks.workunit.client.0.trial099.stdout: 25 16 228010 227994 35.6214 0.375 0.135577 0.00174613 2026-02-12T20:50:13.990 INFO:tasks.workunit.client.0.trial099.stdout: 26 16 231556 231540 34.7841 13.8516 0.00129544 0.0017955 2026-02-12T20:50:14.989 INFO:tasks.workunit.client.0.trial099.stdout: 27 16 242091 242075 35.0198 41.1523 0.00163835 0.00178337 2026-02-12T20:50:15.990 INFO:tasks.workunit.client.0.trial099.stdout: 28 16 252607 252591 35.2361 41.0781 0.00142724 0.00177243 2026-02-12T20:50:16.990 INFO:tasks.workunit.client.0.trial099.stdout: 29 16 263046 263030 35.4271 40.7773 0.00137783 0.00176286 2026-02-12T20:50:17.990 INFO:tasks.workunit.client.0.trial099.stdout:Total time run: 30.0011 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Total writes made: 273487 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Write size: 4096 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Object size: 4096 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Bandwidth (MB/sec): 35.609 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Bandwidth: 12.9257 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Max bandwidth (MB/sec): 45.7383 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Min bandwidth (MB/sec): 0.375 2026-02-12T20:50:17.991 INFO:tasks.workunit.client.0.trial099.stdout:Average IOPS: 9115 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Stddev IOPS: 3308.98 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Max IOPS: 11709 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Min IOPS: 96 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Average Latency(s): 0.00175388 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Latency(s): 0.00612994 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Max latency(s): 0.24551 2026-02-12T20:50:17.992 INFO:tasks.workunit.client.0.trial099.stdout:Min latency(s): 0.000487054 2026-02-12T20:50:17.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 119724 2026-02-12T20:50:17.993 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-12T20:50:18.994 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 119724 2026-02-12T20:50:18.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (119724) - No such process 2026-02-12T20:50:18.995 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-12T20:50:19.241 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:50:19.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 120744 2026-02-12T20:50:19.249 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-12T20:50:20.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 120744 2026-02-12T20:50:20.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (120744) - No such process 2026-02-12T20:50:20.250 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-12T20:50:20.486 INFO:tasks.workunit.client.0.trial099.stderr:osd.1 is already down. 2026-02-12T20:50:20.492 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 121790 2026-02-12T20:50:20.493 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-12T20:50:21.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 121790 2026-02-12T20:50:21.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (121790) - No such process 2026-02-12T20:50:21.494 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-12T20:50:21.721 INFO:tasks.workunit.client.0.trial099.stderr:osd.2 is already down. 2026-02-12T20:50:21.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 122810 2026-02-12T20:50:21.729 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-12T20:50:22.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 122810 2026-02-12T20:50:22.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (122810) - No such process 2026-02-12T20:50:22.730 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-12T20:50:23.011 INFO:tasks.workunit.client.0.trial099.stderr:osd.3 is already down. 2026-02-12T20:50:23.020 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:50:26.515 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:50:26.560 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-12T20:50:26.998 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records in 2026-02-12T20:50:26.998 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records out 2026-02-12T20:50:26.998 INFO:tasks.workunit.client.0.trial099.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.435946 s, 2.5 GB/s 2026-02-12T20:50:26.998 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-12T20:50:27.008 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:50:30.262 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-12T20:50:30.262 INFO:tasks.workunit.client.0.trial099.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-12T20:50:30.280 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:50:33.754 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:50:33.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-12T20:50:34.021 INFO:tasks.workunit.client.0.trial099.stderr:512+0 records in 2026-02-12T20:50:34.021 INFO:tasks.workunit.client.0.trial099.stderr:512+0 records out 2026-02-12T20:50:34.021 INFO:tasks.workunit.client.0.trial099.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.219075 s, 2.5 GB/s 2026-02-12T20:50:34.021 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-12T20:50:34.032 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:50:38.374 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-12T20:50:38.374 INFO:tasks.workunit.client.0.trial099.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-12T20:50:38.393 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-12T20:50:38.454 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:50:41.921 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:50:41.964 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:50:45.427 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:50:45.472 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-12T20:50:45.896 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records in 2026-02-12T20:50:45.896 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records out 2026-02-12T20:50:45.896 INFO:tasks.workunit.client.0.trial099.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.422438 s, 2.5 GB/s 2026-02-12T20:50:45.896 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-12T20:50:45.907 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:50:50.087 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-12T20:50:50.087 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-12T20:50:50.087 INFO:tasks.workunit.client.0.trial099.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-12T20:50:50.108 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-12T20:50:50.232 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:50:53.682 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:50:53.727 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-12T20:50:53.737 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:50:56.655 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-12T20:50:56.671 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-12T20:50:56.793 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-12T20:51:00.187 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:51:00.234 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-12T20:51:03.542 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:51:03.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-12T20:51:04.017 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records in 2026-02-12T20:51:04.017 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records out 2026-02-12T20:51:04.017 INFO:tasks.workunit.client.0.trial099.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.428796 s, 2.5 GB/s 2026-02-12T20:51:04.017 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-12T20:51:04.027 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:51:04.073 INFO:tasks.workunit.client.0.trial099.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-12T20:51:04.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-12T20:51:04.075 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:51:07.421 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:51:07.462 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-12T20:51:08.749 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records in 2026-02-12T20:51:08.749 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records out 2026-02-12T20:51:08.749 INFO:tasks.workunit.client.0.trial099.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.14334 s, 939 MB/s 2026-02-12T20:51:08.749 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-12T20:51:08.759 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:51:11.682 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-12T20:51:11.682 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-12T20:51:11.682 INFO:tasks.workunit.client.0.trial099.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-12T20:51:11.706 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-12T20:51:14.971 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:51:15.021 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-12T20:51:15.454 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records in 2026-02-12T20:51:15.454 INFO:tasks.workunit.client.0.trial099.stderr:1024+0 records out 2026-02-12T20:51:15.455 INFO:tasks.workunit.client.0.trial099.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.432006 s, 2.5 GB/s 2026-02-12T20:51:15.455 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-12T20:51:15.465 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:51:18.959 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-12T20:51:18.959 INFO:tasks.workunit.client.0.trial099.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-12T20:51:18.959 INFO:tasks.workunit.client.0.trial099.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-12T20:51:18.983 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-12T20:51:22.234 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:51:22.277 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:51:22.278 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-12T20:51:22.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:51:22.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:51:22.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:51:22.279 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:51:22.291 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:22.300+0000 7fd011a4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:22.293 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:22.302+0000 7fd011a4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:22.294 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:22.303+0000 7fd011a4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:22.441 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:22.450+0000 7fd011a4c780 -1 Falling back to public interface 2026-02-12T20:51:22.509 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:51:22.509 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:22.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:22.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:23.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:23.735 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:23.735 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:51:23.736 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:51:23.736 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:23.736 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:23.965 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:24.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:24.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:24.967 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:51:24.967 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:51:24.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:24.968 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:25.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:26.201 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:26.201 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:26.202 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:51:26.202 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:51:26.203 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:26.203 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:26.430 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:27.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:27.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:27.432 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:51:27.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:51:27.432 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:27.433 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:27.661 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:28.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:28.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:28.663 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:51:28.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:51:28.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:28.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:28.901 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:28.923 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:28.932+0000 7fd011a4c780 -1 osd.0 63 log_to_monitors true 2026-02-12T20:51:29.902 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:29.903 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:29.903 INFO:tasks.workunit.client.0.trial099.stdout:6 2026-02-12T20:51:29.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-12T20:51:29.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:29.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:51:30.127 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 71 up_thru 71 down_at 63 last_clean_interval [52,63) [v2:127.0.0.1:6800/2970280381,v1:127.0.0.1:6801/2970280381] [v2:127.0.0.1:6802/2970280381,v1:127.0.0.1:6803/2970280381] exists,up 2655302f-6f0f-42d4-9816-2ae02f051ba8 2026-02-12T20:51:30.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:51:30.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:51:30.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:51:30.129 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:51:30.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=129988 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:51:30.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:51:30.134 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-12T20:51:30.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-12T20:51:30.136 INFO:tasks.workunit.client.0.trial099.stdout:start osd.1 2026-02-12T20:51:30.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:51:30.137 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-12T20:51:30.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-12T20:51:30.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:51:30.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:51:30.137 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:51:30.145 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:30.153+0000 7f90711d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:30.146 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:30.155+0000 7f90711d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:30.147 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:30.155+0000 7f90711d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:30.282 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:30.290+0000 7f90711d4780 -1 Falling back to public interface 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:30.356 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:51:30.357 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:51:30.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:30.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:30.578 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:31.580 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:31.580 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:31.580 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:51:31.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:51:31.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:31.581 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:31.811 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:32.812 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:32.813 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:32.813 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:51:32.813 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:51:32.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:32.814 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:33.046 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:34.047 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:34.048 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:34.048 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:51:34.049 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:51:34.049 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:34.049 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:34.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:35.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:35.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:35.287 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:51:35.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:51:35.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:35.288 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:35.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:36.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:36.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:36.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:51:36.517 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:51:36.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:36.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:36.663 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:36.671+0000 7f90711d4780 -1 osd.1 64 log_to_monitors true 2026-02-12T20:51:36.754 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:37.755 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:37.755 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:37.756 INFO:tasks.workunit.client.0.trial099.stdout:6 2026-02-12T20:51:37.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-12T20:51:37.756 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:37.757 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-12T20:51:37.981 INFO:tasks.workunit.client.0.trial099.stdout:osd.1 up in weight 1 up_from 74 up_thru 74 down_at 65 last_clean_interval [55,64) [v2:127.0.0.1:6810/3859608324,v1:127.0.0.1:6811/3859608324] [v2:127.0.0.1:6812/3859608324,v1:127.0.0.1:6813/3859608324] exists,up aae959c7-19da-43d8-a586-8952da94623b 2026-02-12T20:51:37.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:51:37.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:51:37.982 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:51:37.982 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-12T20:51:37.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=131033 2026-02-12T20:51:37.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-12T20:51:37.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:51:37.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:51:37.987 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:51:37.988 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:51:37.989 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-12T20:51:37.990 INFO:tasks.workunit.client.0.trial099.stdout:start osd.2 2026-02-12T20:51:37.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:51:37.991 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-12T20:51:37.991 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-12T20:51:37.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:51:37.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:51:37.992 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:51:37.999 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:38.006+0000 7fca75038780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:38.000 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:38.008+0000 7fca75038780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:38.001 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:38.009+0000 7fca75038780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:38.161 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:38.169+0000 7fca75038780 -1 Falling back to public interface 2026-02-12T20:51:38.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-12T20:51:38.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:51:38.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-12T20:51:38.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:51:38.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:51:38.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:38.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:51:38.215 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:51:38.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:38.216 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:51:38.438 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:39.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:39.440 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:39.440 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:51:39.441 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:51:39.441 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:39.441 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:51:39.670 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:40.671 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:40.672 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:40.672 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:51:40.673 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:51:40.673 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:40.673 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:51:40.902 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:41.903 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:41.904 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:41.904 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:51:41.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:51:41.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:41.905 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:51:42.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:43.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:43.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:43.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:51:43.135 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:51:43.136 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:43.136 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:51:43.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:44.221 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:44.229+0000 7fca75038780 -1 osd.2 66 log_to_monitors true 2026-02-12T20:51:44.367 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:44.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:44.368 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:51:44.368 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:51:44.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:44.369 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-12T20:51:44.601 INFO:tasks.workunit.client.0.trial099.stdout:osd.2 up in weight 1 up_from 78 up_thru 78 down_at 67 last_clean_interval [58,66) [v2:127.0.0.1:6818/3947421093,v1:127.0.0.1:6819/3947421093] [v2:127.0.0.1:6820/3947421093,v1:127.0.0.1:6821/3947421093] exists,up 103b11f9-88ae-4d19-b4e5-707111abe8c6 2026-02-12T20:51:44.601 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:51:44.602 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:51:44.602 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:51:44.602 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-12T20:51:44.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=132068 2026-02-12T20:51:44.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-12T20:51:44.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:51:44.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:51:44.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-12T20:51:44.606 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:51:44.607 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:51:44.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:51:44.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:51:44.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:51:44.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:51:44.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-12T20:51:44.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-12T20:51:44.609 INFO:tasks.workunit.client.0.trial099.stdout:start osd.3 2026-02-12T20:51:44.610 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:51:44.610 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-12T20:51:44.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-12T20:51:44.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:51:44.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:51:44.611 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:51:44.620 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:44.628+0000 7f626682e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:44.621 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:44.630+0000 7f626682e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:44.622 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:44.631+0000 7f626682e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:51:44.828 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:44.836+0000 7f626682e780 -1 Falling back to public interface 2026-02-12T20:51:44.832 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:51:44.833 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:51:44.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:44.834 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:51:45.054 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:46.055 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:46.056 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:46.056 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:51:46.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:51:46.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:46.057 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:51:46.285 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:47.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:47.286 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:47.286 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:51:47.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:51:47.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:47.287 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:51:47.512 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:48.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:48.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:48.514 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:51:48.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:51:48.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:48.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:51:48.737 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:49.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:49.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:49.739 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:51:49.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:51:49.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:49.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:51:49.972 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:51:50.849 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:51:50.857+0000 7f626682e780 -1 osd.3 68 log_to_monitors true 2026-02-12T20:51:50.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:51:50.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:51:50.974 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:51:50.974 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:51:50.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:51:50.975 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-12T20:51:51.205 INFO:tasks.workunit.client.0.trial099.stdout:osd.3 up in weight 1 up_from 81 up_thru 81 down_at 69 last_clean_interval [61,68) [v2:127.0.0.1:6826/1702609069,v1:127.0.0.1:6827/1702609069] [v2:127.0.0.1:6828/1702609069,v1:127.0.0.1:6829/1702609069] exists,up bad5d750-4a8c-4eda-87ab-a29650f08020 2026-02-12T20:51:51.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:51:51.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:51:51.206 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:51:51.206 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-12T20:51:51.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=133083 2026-02-12T20:51:51.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-12T20:51:51.225 INFO:tasks.workunit.client.0.trial099.stdout:hints = 1 2026-02-12T20:51:51.225 INFO:tasks.workunit.client.0.trial099.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-12T20:51:51.225 INFO:tasks.workunit.client.0.trial099.stdout:Object prefix: benchmark_data_trial099_134083 2026-02-12T20:51:51.225 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:51:51.226 INFO:tasks.workunit.client.0.trial099.stdout: 0 0 0 0 0 0 - 0 2026-02-12T20:51:52.225 INFO:tasks.workunit.client.0.trial099.stdout: 1 16 11924 11908 46.5118 46.5156 0.000939024 0.00134127 2026-02-12T20:51:53.225 INFO:tasks.workunit.client.0.trial099.stdout: 2 16 23627 23611 46.1123 45.7148 0.00164765 0.00135357 2026-02-12T20:51:54.225 INFO:tasks.workunit.client.0.trial099.stdout: 3 16 35031 35015 45.5891 44.5469 0.00104174 0.00136927 2026-02-12T20:51:55.225 INFO:tasks.workunit.client.0.trial099.stdout: 4 16 46654 46638 45.5415 45.4023 0.00204022 0.00137072 2026-02-12T20:51:56.225 INFO:tasks.workunit.client.0.trial099.stdout: 5 16 55835 55819 43.6053 35.8633 0.0743575 0.00141663 2026-02-12T20:51:57.226 INFO:tasks.workunit.client.0.trial099.stdout: 6 16 66204 66188 43.0878 40.5039 0.000841192 0.00144912 2026-02-12T20:51:58.226 INFO:tasks.workunit.client.0.trial099.stdout: 7 16 77702 77686 43.3482 44.9141 0.00123416 0.0014404 2026-02-12T20:51:59.226 INFO:tasks.workunit.client.0.trial099.stdout: 8 16 89159 89143 43.5234 44.7539 0.00195076 0.00143458 2026-02-12T20:52:00.226 INFO:tasks.workunit.client.0.trial099.stdout: 9 15 100583 100568 43.6459 44.6289 0.0011647 0.0014306 2026-02-12T20:52:01.226 INFO:tasks.workunit.client.0.trial099.stdout: 10 16 112042 112026 43.7567 44.7578 0.00145794 0.00142698 2026-02-12T20:52:02.226 INFO:tasks.workunit.client.0.trial099.stdout: 11 16 117055 117039 41.5589 19.582 0.0675856 0.00149285 2026-02-12T20:52:03.226 INFO:tasks.workunit.client.0.trial099.stdout: 12 16 118525 118509 38.5742 5.74219 0.00125017 0.00161887 2026-02-12T20:52:04.226 INFO:tasks.workunit.client.0.trial099.stdout: 13 16 129932 129916 39.0343 44.5586 0.00109555 0.0015998 2026-02-12T20:52:05.226 INFO:tasks.workunit.client.0.trial099.stdout: 14 16 141008 140992 39.3363 43.2656 0.000812899 0.00158743 2026-02-12T20:52:06.226 INFO:tasks.workunit.client.0.trial099.stdout: 15 16 152021 152005 39.5816 43.0195 0.00144377 0.00157765 2026-02-12T20:52:07.226 INFO:tasks.workunit.client.0.trial099.stdout: 16 15 162997 162982 39.7875 42.8789 0.00172374 0.00156951 2026-02-12T20:52:08.226 INFO:tasks.workunit.client.0.trial099.stdout: 17 16 173630 173614 39.8899 41.5312 0.00133136 0.00156547 2026-02-12T20:52:09.226 INFO:tasks.workunit.client.0.trial099.stdout: 18 16 174581 174565 37.8801 3.71484 0.143986 0.00164421 2026-02-12T20:52:10.226 INFO:tasks.workunit.client.0.trial099.stdout: 19 16 183870 183854 37.7961 36.2852 0.0011973 0.00165227 2026-02-12T20:52:11.227 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:52:11.236431+0000 min lat: 0.000471546 max lat: 0.159284 avg lat: 0.00164217 2026-02-12T20:52:11.227 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:52:11.227 INFO:tasks.workunit.client.0.trial099.stdout: 20 16 194734 194718 38.028 42.4375 0.00206388 0.00164217 2026-02-12T20:52:12.227 INFO:tasks.workunit.client.0.trial099.stdout: 21 16 205599 205583 38.238 42.4414 0.00119006 0.00163306 2026-02-12T20:52:13.227 INFO:tasks.workunit.client.0.trial099.stdout: 22 16 216379 216363 38.4138 42.1094 0.00235987 0.00162567 2026-02-12T20:52:14.227 INFO:tasks.workunit.client.0.trial099.stdout: 23 16 227468 227452 38.6268 43.3164 0.00206191 0.00161671 2026-02-12T20:52:15.227 INFO:tasks.workunit.client.0.trial099.stdout: 24 16 238397 238381 38.796 42.6914 0.00156949 0.00160967 2026-02-12T20:52:16.227 INFO:tasks.workunit.client.0.trial099.stdout: 25 16 249137 249121 38.9222 41.9531 0.00112226 0.00160443 2026-02-12T20:52:17.227 INFO:tasks.workunit.client.0.trial099.stdout: 26 16 260103 260087 39.0726 42.8359 0.00147481 0.00159825 2026-02-12T20:52:18.227 INFO:tasks.workunit.client.0.trial099.stdout: 27 15 270966 270951 39.1971 42.4375 0.00151215 0.00159318 2026-02-12T20:52:19.227 INFO:tasks.workunit.client.0.trial099.stdout: 28 15 281838 281823 39.3138 42.4688 0.00114176 0.00158845 2026-02-12T20:52:20.227 INFO:tasks.workunit.client.0.trial099.stdout: 29 16 285583 285567 38.4624 14.625 0.136951 0.00162037 2026-02-12T20:52:21.227 INFO:tasks.workunit.client.0.trial099.stdout: 30 16 285704 285688 37.1961 0.472656 0.179048 0.00167685 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Total time run: 30.1102 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Total writes made: 285704 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Write size: 4096 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Object size: 4096 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Bandwidth (MB/sec): 37.0649 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Bandwidth: 13.4352 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Max bandwidth (MB/sec): 46.5156 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Min bandwidth (MB/sec): 0.472656 2026-02-12T20:52:22.228 INFO:tasks.workunit.client.0.trial099.stdout:Average IOPS: 9488 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Stddev IOPS: 3439.42 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Max IOPS: 11908 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Min IOPS: 121 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Average Latency(s): 0.00168269 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Latency(s): 0.00529908 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Max latency(s): 0.200208 2026-02-12T20:52:22.229 INFO:tasks.workunit.client.0.trial099.stdout:Min latency(s): 0.000471546 2026-02-12T20:52:22.231 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-12T20:52:22.231 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:52:22.231 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:52:22.231 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:52:22.231 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:52:22.232 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:52:22.232 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:52:22.232 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:52:22.232 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:52:22.232 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:52:22.317 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:52:22.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:52:22.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:52:22.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:52:22.318 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:52:22.318 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr:1 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr:2 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr:3' 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:52:22.541 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:52:22.605 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678029 2026-02-12T20:52:22.605 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678029 2026-02-12T20:52:22.605 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678029' 2026-02-12T20:52:22.605 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:52:22.605 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-12T20:52:22.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=317827579916 2026-02-12T20:52:22.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 317827579916 2026-02-12T20:52:22.668 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678029 1-317827579916' 2026-02-12T20:52:22.669 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:52:22.669 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-12T20:52:22.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449098 2026-02-12T20:52:22.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449098 2026-02-12T20:52:22.733 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678029 1-317827579916 2-335007449098' 2026-02-12T20:52:22.734 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:52:22.734 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-12T20:52:22.798 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350985 2026-02-12T20:52:22.798 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350985 2026-02-12T20:52:22.799 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678029 1-317827579916 2-335007449098 3-347892350985' 2026-02-12T20:52:22.799 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:52:22.799 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-304942678029 2026-02-12T20:52:22.800 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:52:22.800 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:52:22.800 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-304942678029 2026-02-12T20:52:22.800 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:52:22.801 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678029 2026-02-12T20:52:22.802 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 304942678029' 2026-02-12T20:52:22.802 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 304942678029 2026-02-12T20:52:22.802 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:52:23.027 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678027 -lt 304942678029 2026-02-12T20:52:23.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:52:24.028 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:52:24.029 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:52:24.256 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678029 -lt 304942678029 2026-02-12T20:52:24.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:52:24.257 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-317827579916 2026-02-12T20:52:24.257 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:52:24.258 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-12T20:52:24.259 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-317827579916 2026-02-12T20:52:24.259 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:52:24.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=317827579916 2026-02-12T20:52:24.260 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 317827579916' 2026-02-12T20:52:24.260 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.1 seq 317827579916 2026-02-12T20:52:24.261 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-12T20:52:24.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 317827579916 -lt 317827579916 2026-02-12T20:52:24.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:52:24.486 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-335007449098 2026-02-12T20:52:24.486 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:52:24.487 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-12T20:52:24.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-335007449098 2026-02-12T20:52:24.488 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:52:24.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449098 2026-02-12T20:52:24.489 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.2 seq 335007449098 2026-02-12T20:52:24.489 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 335007449098' 2026-02-12T20:52:24.490 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-12T20:52:24.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449098 -lt 335007449098 2026-02-12T20:52:24.715 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:52:24.715 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-347892350985 2026-02-12T20:52:24.716 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:52:24.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-12T20:52:24.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-347892350985 2026-02-12T20:52:24.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:52:24.718 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=347892350985 2026-02-12T20:52:24.719 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.3 seq 347892350985 2026-02-12T20:52:24.719 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 347892350985' 2026-02-12T20:52:24.719 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-12T20:52:24.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 347892350985 -lt 347892350985 2026-02-12T20:52:24.954 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:52:24.955 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:52:24.955 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:52:25.269 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:52:25.490 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-12T20:52:25.491 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:52:25.491 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:52:25.491 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:52:25.818 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:52:25.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:52:25.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:52:25.819 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:52:26.128 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:52:26.129 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:52:26.130 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:52:26.130 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:52:26.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:52:26.132 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:52:26.132 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:52:26.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:52:26.133 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:52:26.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:52:26.134 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:52:26.134 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:52:26.135 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:52:26.136 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-12T20:52:32.507 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:52:32.508 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.508 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.508 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.89625 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-12T20:52:32.510 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:52:32.511 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:52:32.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:52:32.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:52:32.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:52:32.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:52:32.511 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:52:32.512 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:52:32.512 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:52:32.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:52:32.513 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:52:32.514 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:52:32.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:52:32.514 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:52:32.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:52:32.515 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:52:32.515 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:52:32.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:52:32.516 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-12T20:52:32.517 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:52:32.518 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.518 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.89625 2026-02-12T20:52:32.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:52:32.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:52:32.519 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-12T20:52:32.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:52:32.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.520 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.520 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.89625 2026-02-12T20:52:32.521 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:52:32.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-12T20:52:32.522 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-12T20:52:32.523 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-12T20:52:32.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none ' 2026-02-12T20:52:32.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-12T20:52:32.525 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:52:32.526 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:52:32.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-12T20:52:32.527 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.545 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:52:32.545 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:52:32.545 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:52:32.545 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:52:32.545 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.546 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.546 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:52:32.546 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:52:32.571 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:52:32.572 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:52:32.572 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:52:32.572 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:52:32.572 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:52:32.573 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:52:32.573 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:52:32.573 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:52:32.573 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:52:32.574 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:52:32.574 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.574 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.574 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.89625/ceph-mon.a.asok 2026-02-12T20:52:32.574 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:52:32.574 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.89625/ceph-mon.a.asok config get fsid 2026-02-12T20:52:32.618 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:52:32.619 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:52:32.620 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:52:32.620 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.620 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.620 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.89625/ceph-mon.a.asok 2026-02-12T20:52:32.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:52:32.621 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.89625/ceph-mon.a.asok config get mon_host 2026-02-12T20:52:32.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-12T20:52:32.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.663 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:52:32.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:52:32.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:52:32.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-12T20:52:32.664 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:52:32.764 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:52:32.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:52:32.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:52:32.765 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:52:32.765 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.765 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.765 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:52:32.766 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:52:32.766 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:52:32.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:52:32.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:52:32.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:52:32.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:52:32.788 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:52:32.789 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:52:32.790 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=405ac1d6-1034-49ad-a020-c0e48dc952a1 2026-02-12T20:52:32.790 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 405ac1d6-1034-49ad-a020-c0e48dc952a1 2026-02-12T20:52:32.790 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 405ac1d6-1034-49ad-a020-c0e48dc952a1' 2026-02-12T20:52:32.791 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:52:32.800 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCQPY5ph683MBAARptlbtIu5RgICAfj+FRjNQ== 2026-02-12T20:52:32.800 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCQPY5ph683MBAARptlbtIu5RgICAfj+FRjNQ=="}' 2026-02-12T20:52:32.800 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 405ac1d6-1034-49ad-a020-c0e48dc952a1 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-12T20:52:32.906 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:52:32.913 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-12T20:52:32.914 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCQPY5ph683MBAARptlbtIu5RgICAfj+FRjNQ== --osd-uuid 405ac1d6-1034-49ad-a020-c0e48dc952a1 2026-02-12T20:52:32.934 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:32.942+0000 7f18ddc2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:52:32.935 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:32.944+0000 7f18ddc2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:52:32.936 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:32.945+0000 7f18ddc2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:52:32.937 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:32.945+0000 7f18ddc2c780 -1 bdev(0x3ee8000 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:52:32.937 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:32.945+0000 7f18ddc2c780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-12T20:52:33.743 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-12T20:52:33.743 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:52:33.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:52:33.744 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:52:33.744 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:52:33.853 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:52:33.853 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:52:33.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:52:33.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:52:33.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:52:33.854 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:52:33.871 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:33.880+0000 7fd46a662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:52:33.873 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:33.882+0000 7fd46a662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:52:33.874 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:33.882+0000 7fd46a662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:52:33.957 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:52:33.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:52:33.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:52:33.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:52:33.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:52:33.958 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:52:33.958 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:52:33.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:52:33.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:52:33.959 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:52:34.062 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:52:34.099 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:34.107+0000 7fd46a662780 -1 Falling back to public interface 2026-02-12T20:52:34.708 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:52:34.717+0000 7fd46a662780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:52:35.063 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:52:35.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:52:35.064 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:52:35.064 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:52:35.065 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:52:35.065 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:52:35.300 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1481138368,v1:127.0.0.1:6801/1481138368] [v2:127.0.0.1:6802/1481138368,v1:127.0.0.1:6803/1481138368] exists,up 405ac1d6-1034-49ad-a020-c0e48dc952a1 2026-02-12T20:52:35.301 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:52:35.301 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:52:35.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:52:35.302 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:52:35.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=135921 2026-02-12T20:52:35.302 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-12T20:52:40.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-12T20:52:40.303 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-12T20:52:40.580 INFO:tasks.workunit.client.0.trial099.stderr:pool 'foo' already exists 2026-02-12T20:52:40.589 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:52:41.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-12T20:52:41.591 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-12T20:52:41.592 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-12T20:52:41.592 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-12T20:52:41.612 INFO:tasks.workunit.client.0.trial099.stdout:hints = 1 2026-02-12T20:52:41.613 INFO:tasks.workunit.client.0.trial099.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-12T20:52:41.613 INFO:tasks.workunit.client.0.trial099.stdout:Object prefix: benchmark_data_trial099_137056 2026-02-12T20:52:41.632 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:52:41.633 INFO:tasks.workunit.client.0.trial099.stdout: 0 0 0 0 0 0 - 0 2026-02-12T20:52:42.632 INFO:tasks.workunit.client.0.trial099.stdout: 1 16 189 173 691.946 692 0.0751565 0.0896931 2026-02-12T20:52:43.632 INFO:tasks.workunit.client.0.trial099.stdout: 2 16 384 368 735.944 780 0.0811615 0.0853432 2026-02-12T20:52:44.633 INFO:tasks.workunit.client.0.trial099.stdout: 3 16 564 548 730.611 720 0.0804534 0.0860108 2026-02-12T20:52:45.633 INFO:tasks.workunit.client.0.trial099.stdout: 4 16 768 752 751.942 816 0.0835132 0.084727 2026-02-12T20:52:46.633 INFO:tasks.workunit.client.0.trial099.stdout: 5 16 973 957 765.54 820 0.0817373 0.0829812 2026-02-12T20:52:47.633 INFO:tasks.workunit.client.0.trial099.stdout: 6 16 1172 1156 770.608 796 0.0847498 0.0826248 2026-02-12T20:52:48.633 INFO:tasks.workunit.client.0.trial099.stdout: 7 16 1348 1332 761.083 704 0.0666616 0.0837089 2026-02-12T20:52:49.633 INFO:tasks.workunit.client.0.trial099.stdout: 8 16 1556 1540 769.938 832 0.0769948 0.0828811 2026-02-12T20:52:50.633 INFO:tasks.workunit.client.0.trial099.stdout: 9 16 1760 1744 775.049 816 0.0743468 0.0822729 2026-02-12T20:52:51.633 INFO:tasks.workunit.client.0.trial099.stdout: 10 16 1940 1924 769.537 720 0.0834971 0.0826708 2026-02-12T20:52:52.633 INFO:tasks.workunit.client.0.trial099.stdout:Total time run: 10.0317 2026-02-12T20:52:52.633 INFO:tasks.workunit.client.0.trial099.stdout:Total writes made: 1940 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Write size: 4194304 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Object size: 4194304 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Bandwidth (MB/sec): 773.547 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Bandwidth: 54.5592 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Max bandwidth (MB/sec): 832 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Min bandwidth (MB/sec): 692 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Average IOPS: 193 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Stddev IOPS: 13.6398 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Max IOPS: 208 2026-02-12T20:52:52.634 INFO:tasks.workunit.client.0.trial099.stdout:Min IOPS: 173 2026-02-12T20:52:52.635 INFO:tasks.workunit.client.0.trial099.stdout:Average Latency(s): 0.0826298 2026-02-12T20:52:52.635 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Latency(s): 0.0103989 2026-02-12T20:52:52.635 INFO:tasks.workunit.client.0.trial099.stdout:Max latency(s): 0.120797 2026-02-12T20:52:52.635 INFO:tasks.workunit.client.0.trial099.stdout:Min latency(s): 0.0245604 2026-02-12T20:52:52.643 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-12T20:53:02.645 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-12T20:53:02.646 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-12T20:53:02.716 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=997195776 2026-02-12T20:53:02.716 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-12T20:53:02.717 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-12T20:53:02.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=105906176 2026-02-12T20:53:02.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-12T20:53:02.786 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 105906176 -eq 0 2026-02-12T20:53:02.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-12T20:53:02.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 105906176 -gt 0 2026-02-12T20:53:02.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 135921 2026-02-12T20:53:02.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-12T20:53:03.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 135921 2026-02-12T20:53:03.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (135921) - No such process 2026-02-12T20:53:03.787 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-12T20:53:04.027 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:53:04.034 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-12T20:53:04.046 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:53:05.806 INFO:tasks.workunit.client.0.trial099.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-12T20:53:05.829 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-12T20:53:05.841 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:53:06.320 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x100000000(4 GiB) : using 0x41718000(1.0 GiB) : bluefs used 0x41700000(1.0 GiB) : non-bluefs used 0x18000(96 KiB) 2026-02-12T20:53:06.366 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-12T20:53:07.964 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:53:08.035 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:08.036 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:53:08.037 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:53:08.038 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:53:08.039 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:53:08.039 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-12T20:53:08.039 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:53:08.039 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:53:08.039 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:53:08.039 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:53:08.051 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:08.060+0000 7f0cf2c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:08.053 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:08.062+0000 7f0cf2c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:08.054 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:08.062+0000 7f0cf2c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:08.178 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:08.186+0000 7f0cf2c31780 -1 Falling back to public interface 2026-02-12T20:53:08.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:53:08.265 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:53:08.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:53:08.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:53:08.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:53:08.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:53:08.266 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:53:08.266 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:53:08.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:53:08.267 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:53:08.509 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:53:09.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:53:09.510 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:53:09.511 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:53:09.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:53:09.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:53:09.511 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:53:09.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:53:10.511 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:10.520+0000 7f0cf2c31780 -1 osd.0 9 log_to_monitors true 2026-02-12T20:53:10.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:53:10.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:53:10.768 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:53:10.769 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:53:10.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:53:10.769 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:53:11.021 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 12 up_thru 6 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6800/586734595,v1:127.0.0.1:6801/586734595] [v2:127.0.0.1:6802/586734595,v1:127.0.0.1:6803/586734595] exists,up 405ac1d6-1034-49ad-a020-c0e48dc952a1 2026-02-12T20:53:11.021 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:53:11.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:53:11.022 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:53:11.022 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:53:11.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=138287 2026-02-12T20:53:11.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-12T20:53:11.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:53:11.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:53:11.023 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:53:11.023 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:53:11.024 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:53:11.024 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:53:11.024 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:53:11.024 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:53:11.025 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:53:11.110 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:53:11.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:53:11.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:53:11.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:53:11.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:53:11.111 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:53:11.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-12T20:53:11.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:53:11.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:53:11.349 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:53:11.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-12T20:53:11.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-12T20:53:11.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-51539607555' 2026-02-12T20:53:11.419 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:53:11.420 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-51539607555 2026-02-12T20:53:11.420 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:53:11.421 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:53:11.421 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-12T20:53:11.421 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:53:11.422 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=51539607555 2026-02-12T20:53:11.423 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-12T20:53:11.423 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 51539607555 2026-02-12T20:53:11.423 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:53:11.652 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 51539607555 2026-02-12T20:53:11.653 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:53:12.654 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:53:12.654 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:53:12.890 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-12T20:53:12.890 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:53:12.891 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:53:12.891 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:53:13.213 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:53:13.214 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:53:13.444 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-12T20:53:13.445 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:53:13.445 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:53:13.445 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:53:13.766 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-12T20:53:13.766 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:53:13.766 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:53:13.767 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:53:13.872 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:53:13.873 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:53:13.873 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:53:13.874 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:53:13.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:53:13.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:53:13.876 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:53:13.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:53:13.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:53:13.877 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:53:13.877 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:53:13.878 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:53:13.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:53:13.879 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-12T20:53:14.189 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:53:14.190 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.190 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.190 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.89625 2026-02-12T20:53:14.191 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:53:14.192 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:53:14.193 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:53:14.193 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:53:14.193 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:53:14.194 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:53:14.194 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:53:14.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:53:14.195 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:53:14.195 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:53:14.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:53:14.196 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:53:14.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:53:14.197 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:53:14.197 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:53:14.198 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-12T20:53:14.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-12T20:53:14.199 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:53:14.199 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.199 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.89625 2026-02-12T20:53:14.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:53:14.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:53:14.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-12T20:53:14.202 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-12T20:53:14.202 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.202 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.202 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.89625 2026-02-12T20:53:14.203 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-12T20:53:14.204 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-12T20:53:14.205 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-12T20:53:14.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=b19848f4-d1f8-4f8c-979f-a78f13987b27 --auth-supported=none ' 2026-02-12T20:53:14.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-12T20:53:14.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-12T20:53:14.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-12T20:53:14.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-12T20:53:14.207 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-12T20:53:14.208 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.229 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:53:14.230 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-12T20:53:14.257 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-12T20:53:14.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-12T20:53:14.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:53:14.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:53:14.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-12T20:53:14.258 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.89625/ceph-mon.a.asok 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:53:14.260 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.89625/ceph-mon.a.asok config get fsid 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.89625/ceph-mon.a.asok 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-12T20:53:14.306 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.89625/ceph-mon.a.asok config get mon_host 2026-02-12T20:53:14.348 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-12T20:53:14.348 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.348 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-12T20:53:14.348 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-12T20:53:14.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-12T20:53:14.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-12T20:53:14.349 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-12T20:53:14.454 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-12T20:53:14.455 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:53:14.455 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:53:14.455 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:53:14.455 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.455 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.455 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:53:14.456 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:53:14.456 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:53:14.478 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=b19848f4-d1f8-4f8c-979f-a78f13987b27 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:53:14.479 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:53:14.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=783ebb70-0896-4959-a973-b07569417221 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 783ebb70-0896-4959-a973-b07569417221' 2026-02-12T20:53:14.481 INFO:tasks.workunit.client.0.trial099.stdout:add osd0 783ebb70-0896-4959-a973-b07569417221 2026-02-12T20:53:14.482 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-12T20:53:14.491 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC6PY5p+bHaHRAAOyCMCREHoAZU1C+CXryOVQ== 2026-02-12T20:53:14.492 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC6PY5p+bHaHRAAOyCMCREHoAZU1C+CXryOVQ=="}' 2026-02-12T20:53:14.492 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 783ebb70-0896-4959-a973-b07569417221 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-12T20:53:14.601 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:53:14.608 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-12T20:53:14.609 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=b19848f4-d1f8-4f8c-979f-a78f13987b27 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC6PY5p+bHaHRAAOyCMCREHoAZU1C+CXryOVQ== --osd-uuid 783ebb70-0896-4959-a973-b07569417221 2026-02-12T20:53:14.632 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:14.641+0000 7f528a05d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:14.634 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:14.643+0000 7f528a05d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:14.635 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:14.644+0000 7f528a05d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:14.635 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:14.644+0000 7f528a05d780 -1 bdev(0x3016000 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-12T20:53:14.635 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:14.644+0000 7f528a05d780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-12T20:53:15.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-12T20:53:15.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-12T20:53:15.357 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-12T20:53:15.358 INFO:tasks.workunit.client.0.trial099.stdout:adding osd0 key to auth repository 2026-02-12T20:53:15.358 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-12T20:53:15.472 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:53:15.473 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-12T20:53:15.473 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=b19848f4-d1f8-4f8c-979f-a78f13987b27 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:53:15.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-12T20:53:15.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-12T20:53:15.474 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-12T20:53:15.492 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:15.501+0000 7fabe3012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:15.494 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:15.503+0000 7fabe3012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:15.495 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:15.504+0000 7fabe3012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:53:15.578 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-12T20:53:15.578 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:53:15.578 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:53:15.578 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:53:15.579 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:53:15.579 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:53:15.579 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:53:15.579 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:53:15.580 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:53:15.580 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:53:15.682 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:53:15.700 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:15.708+0000 7fabe3012780 -1 Falling back to public interface 2026-02-12T20:53:16.334 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:53:16.343+0000 7fabe3012780 -1 osd.0 0 log_to_monitors true 2026-02-12T20:53:16.683 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:53:16.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:53:16.684 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:53:16.684 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:53:16.685 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:53:16.685 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:53:16.918 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3798371293,v1:127.0.0.1:6801/3798371293] [v2:127.0.0.1:6802/3798371293,v1:127.0.0.1:6803/3798371293] exists,up 783ebb70-0896-4959-a973-b07569417221 2026-02-12T20:53:16.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:53:16.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:53:16.919 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:53:16.920 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:53:16.920 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=140820 2026-02-12T20:53:16.920 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-12T20:53:21.921 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-12T20:53:21.922 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-12T20:53:22.208 INFO:tasks.workunit.client.0.trial099.stderr:pool 'foo' already exists 2026-02-12T20:53:22.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-12T20:53:23.217 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-12T20:53:23.241 INFO:tasks.workunit.client.0.trial099.stdout:hints = 1 2026-02-12T20:53:23.241 INFO:tasks.workunit.client.0.trial099.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-12T20:53:23.241 INFO:tasks.workunit.client.0.trial099.stdout:Object prefix: benchmark_data_trial099_142235 2026-02-12T20:53:23.241 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:53:23.241 INFO:tasks.workunit.client.0.trial099.stdout: 0 0 0 0 0 0 - 0 2026-02-12T20:53:24.241 INFO:tasks.workunit.client.0.trial099.stdout: 1 16 18493 18477 72.1704 72.1758 0.000631282 0.000864856 2026-02-12T20:53:25.241 INFO:tasks.workunit.client.0.trial099.stdout: 2 16 36545 36529 71.3405 70.5156 0.00040912 0.000875078 2026-02-12T20:53:26.241 INFO:tasks.workunit.client.0.trial099.stdout: 3 16 54613 54597 71.0846 70.5781 0.00136204 0.000878418 2026-02-12T20:53:27.241 INFO:tasks.workunit.client.0.trial099.stdout: 4 16 72455 72439 70.7361 69.6953 0.000961726 0.000882771 2026-02-12T20:53:28.241 INFO:tasks.workunit.client.0.trial099.stdout: 5 16 90250 90234 70.4902 69.5117 0.000492013 0.00088586 2026-02-12T20:53:29.241 INFO:tasks.workunit.client.0.trial099.stdout: 6 16 108096 108080 70.3595 69.7109 0.00120633 0.000887555 2026-02-12T20:53:30.241 INFO:tasks.workunit.client.0.trial099.stdout: 7 16 125270 125254 69.8911 67.0859 0.000770371 0.000893498 2026-02-12T20:53:31.241 INFO:tasks.workunit.client.0.trial099.stdout: 8 16 141900 141884 69.2742 64.9609 0.001105 0.000901466 2026-02-12T20:53:32.241 INFO:tasks.workunit.client.0.trial099.stdout: 9 16 158619 158603 68.8331 65.3086 0.00105976 0.000907252 2026-02-12T20:53:33.242 INFO:tasks.workunit.client.0.trial099.stdout: 10 15 174736 174721 68.2454 62.9609 0.000640299 0.000915055 2026-02-12T20:53:34.241 INFO:tasks.workunit.client.0.trial099.stdout: 11 16 190758 190742 67.7301 62.582 0.00170982 0.000922018 2026-02-12T20:53:35.242 INFO:tasks.workunit.client.0.trial099.stdout: 12 16 206634 206618 67.2535 62.0156 0.00135192 0.000928551 2026-02-12T20:53:36.242 INFO:tasks.workunit.client.0.trial099.stdout: 13 16 222820 222804 66.9434 63.2266 0.0013775 0.000932857 2026-02-12T20:53:37.242 INFO:tasks.workunit.client.0.trial099.stdout: 14 16 238924 238908 66.6547 62.9062 0.00058723 0.000936914 2026-02-12T20:53:38.242 INFO:tasks.workunit.client.0.trial099.stdout: 15 16 255204 255188 66.4503 63.5938 0.000669103 0.000939799 2026-02-12T20:53:39.242 INFO:tasks.workunit.client.0.trial099.stdout: 16 16 271412 271396 66.2539 63.3125 0.00123724 0.000942587 2026-02-12T20:53:40.242 INFO:tasks.workunit.client.0.trial099.stdout: 17 16 287380 287364 66.0254 62.375 0.000849617 0.000945856 2026-02-12T20:53:41.242 INFO:tasks.workunit.client.0.trial099.stdout: 18 16 303449 303433 65.8443 62.7695 0.00135189 0.000948454 2026-02-12T20:53:42.242 INFO:tasks.workunit.client.0.trial099.stdout: 19 16 319459 319443 65.6701 62.5391 0.000972756 0.000950957 2026-02-12T20:53:43.242 INFO:tasks.workunit.client.0.trial099.stdout:2026-02-12T20:53:43.252381+0000 min lat: 0.000260754 max lat: 0.00521684 avg lat: 0.000953383 2026-02-12T20:53:43.242 INFO:tasks.workunit.client.0.trial099.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-12T20:53:43.242 INFO:tasks.workunit.client.0.trial099.stdout: 20 16 335422 335406 65.5041 62.3555 0.000755804 0.000953383 2026-02-12T20:53:44.242 INFO:tasks.workunit.client.0.trial099.stdout: 21 16 351762 351746 65.424 63.8281 0.000895493 0.000954559 2026-02-12T20:53:45.242 INFO:tasks.workunit.client.0.trial099.stdout: 22 16 368160 368144 65.3616 64.0547 0.00104685 0.000955475 2026-02-12T20:53:46.242 INFO:tasks.workunit.client.0.trial099.stdout: 23 16 384492 384476 65.2933 63.7969 0.000776342 0.000956467 2026-02-12T20:53:47.243 INFO:tasks.workunit.client.0.trial099.stdout: 24 16 400558 400542 65.1875 62.7578 0.000519314 0.000957998 2026-02-12T20:53:48.243 INFO:tasks.workunit.client.0.trial099.stdout: 25 15 416731 416716 65.107 63.1797 0.000689962 0.000959215 2026-02-12T20:53:49.243 INFO:tasks.workunit.client.0.trial099.stdout: 26 16 431853 431837 64.8745 59.0664 0.00411406 0.00095985 2026-02-12T20:53:50.243 INFO:tasks.workunit.client.0.trial099.stdout: 27 16 431984 431968 62.4908 0.511719 0.0793626 0.000996517 2026-02-12T20:53:51.243 INFO:tasks.workunit.client.0.trial099.stdout: 28 16 432348 432332 60.3097 1.42188 0.0173097 0.00103522 2026-02-12T20:53:52.243 INFO:tasks.workunit.client.0.trial099.stdout: 29 16 432750 432734 58.2842 1.57031 0.102616 0.00107 2026-02-12T20:53:53.243 INFO:tasks.workunit.client.0.trial099.stdout: 30 16 432978 432962 56.3711 0.890625 0.161861 0.00110618 2026-02-12T20:53:54.243 INFO:tasks.workunit.client.0.trial099.stdout:Total time run: 30.1026 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Total writes made: 432978 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Write size: 4096 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Object size: 4096 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Bandwidth (MB/sec): 56.1852 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Bandwidth: 22.2743 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Max bandwidth (MB/sec): 72.1758 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Min bandwidth (MB/sec): 0.511719 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Average IOPS: 14383 2026-02-12T20:53:54.244 INFO:tasks.workunit.client.0.trial099.stdout:Stddev IOPS: 5702.22 2026-02-12T20:53:54.245 INFO:tasks.workunit.client.0.trial099.stdout:Max IOPS: 18477 2026-02-12T20:53:54.245 INFO:tasks.workunit.client.0.trial099.stdout:Min IOPS: 131 2026-02-12T20:53:54.245 INFO:tasks.workunit.client.0.trial099.stdout:Average Latency(s): 0.00111109 2026-02-12T20:53:54.245 INFO:tasks.workunit.client.0.trial099.stdout:Stddev Latency(s): 0.00378329 2026-02-12T20:53:54.245 INFO:tasks.workunit.client.0.trial099.stdout:Max latency(s): 0.267284 2026-02-12T20:53:54.245 INFO:tasks.workunit.client.0.trial099.stdout:Min latency(s): 0.000260754 2026-02-12T20:53:54.371 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-12T20:53:59.373 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-12T20:53:59.374 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-12T20:53:59.448 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-12T20:53:59.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-12T20:53:59.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-12T20:53:59.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-12T20:53:59.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-12T20:53:59.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-12T20:53:59.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-12T20:53:59.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2521391104 2026-02-12T20:53:59.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 140820 2026-02-12T20:53:59.517 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-12T20:54:00.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 140820 2026-02-12T20:54:00.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (140820) - No such process 2026-02-12T20:54:00.518 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-12T20:54:00.754 INFO:tasks.workunit.client.0.trial099.stderr:osd.0 is already down. 2026-02-12T20:54:00.761 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-12T20:54:00.777 INFO:tasks.workunit.client.0.trial099.stdout:allocmap bluestore.allocmap 2026-02-12T20:54:43.209 INFO:tasks.workunit.client.0.trial099.stdout:allocmap success 2026-02-12T20:54:43.238 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:55:27.518 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:55:27.551 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-12T20:55:27.551 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-12T20:55:27.552 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-12T20:55:27.568 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:56:08.751 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0x30900000(777 MiB) 2026-02-12T20:56:08.751 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0x100000000(4 GiB) : using 0x69b6c000(1.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x69b6c000(1.7 GiB) 2026-02-12T20:56:08.751 INFO:tasks.workunit.client.0.trial099.stdout:Expanding DB/WAL... 2026-02-12T20:56:08.752 INFO:tasks.workunit.client.0.trial099.stdout:1 : nothing to do, skipped 2026-02-12T20:56:08.752 INFO:tasks.workunit.client.0.trial099.stdout:2 : nothing to do, skipped 2026-02-12T20:56:08.826 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-12T20:56:52.600 INFO:tasks.workunit.client.0.trial099.stdout:fsck success 2026-02-12T20:56:52.631 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-12T20:56:52.646 INFO:tasks.workunit.client.0.trial099.stdout:qfsck bluestore.quick-fsck 2026-02-12T20:57:34.675 INFO:tasks.workunit.client.0.trial099.stdout:qfsck success 2026-02-12T20:57:34.702 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-12T20:57:34.717 INFO:tasks.workunit.client.0.trial099.stdout:inferring bluefs devices from bluestore path 2026-02-12T20:58:15.874 INFO:tasks.workunit.client.0.trial099.stdout:1 : device size 0x40000000(1 GiB) : using 0x30900000(777 MiB) 2026-02-12T20:58:15.874 INFO:tasks.workunit.client.0.trial099.stdout:2 : device size 0x100000000(4 GiB) : using 0x69b6c000(1.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x69b6c000(1.7 GiB) 2026-02-12T20:58:15.949 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=b19848f4-d1f8-4f8c-979f-a78f13987b27 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-12T20:58:15.950 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:58:15.951 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-12T20:58:15.952 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-12T20:58:15.953 INFO:tasks.workunit.client.0.trial099.stdout:start osd.0 2026-02-12T20:58:15.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=08c510d3-a339-4940-a756-fb444bda5ef9 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=fcd9d439-9c9f-4746-a776-f935959e46f1 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=b19848f4-d1f8-4f8c-979f-a78f13987b27 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.89625/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-12T20:58:15.954 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-12T20:58:15.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-12T20:58:15.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-12T20:58:15.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-12T20:58:15.954 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-12T20:58:15.970 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:58:15.979+0000 7f6049237780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:58:15.972 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:58:15.981+0000 7f6049237780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:58:15.973 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:58:15.982+0000 7f6049237780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-12T20:58:16.136 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:58:16.145+0000 7f6049237780 -1 Falling back to public interface 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:16.199 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-12T20:58:16.200 INFO:tasks.workunit.client.0.trial099.stdout:0 2026-02-12T20:58:16.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:16.200 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:16.441 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:17.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:17.442 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:17.443 INFO:tasks.workunit.client.0.trial099.stdout:1 2026-02-12T20:58:17.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-12T20:58:17.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:17.443 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:17.675 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:18.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:18.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:18.677 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-12T20:58:18.677 INFO:tasks.workunit.client.0.trial099.stdout:2 2026-02-12T20:58:18.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:18.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:18.913 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:19.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:19.915 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:19.915 INFO:tasks.workunit.client.0.trial099.stdout:3 2026-02-12T20:58:19.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-12T20:58:19.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:19.916 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:20.153 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:21.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:21.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:21.155 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-12T20:58:21.155 INFO:tasks.workunit.client.0.trial099.stdout:4 2026-02-12T20:58:21.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:21.156 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:21.388 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:22.389 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:22.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:22.390 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-12T20:58:22.390 INFO:tasks.workunit.client.0.trial099.stdout:5 2026-02-12T20:58:22.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:22.391 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:22.634 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:23.635 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:23.635 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:23.636 INFO:tasks.workunit.client.0.trial099.stdout:6 2026-02-12T20:58:23.636 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-12T20:58:23.637 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:23.637 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:23.873 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:24.874 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:24.874 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:24.875 INFO:tasks.workunit.client.0.trial099.stdout:7 2026-02-12T20:58:24.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-12T20:58:24.875 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:24.876 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:25.109 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-12T20:58:25.616 INFO:tasks.workunit.client.0.trial099.stderr:2026-02-12T20:58:25.624+0000 7f6049237780 -1 osd.0 10 log_to_monitors true 2026-02-12T20:58:26.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-12T20:58:26.111 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-12T20:58:26.111 INFO:tasks.workunit.client.0.trial099.stdout:8 2026-02-12T20:58:26.112 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-12T20:58:26.112 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-12T20:58:26.112 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-12T20:58:26.342 INFO:tasks.workunit.client.0.trial099.stdout:osd.0 up in weight 1 up_from 13 up_thru 13 down_at 10 last_clean_interval [5,10) [v2:127.0.0.1:6800/2904763972,v1:127.0.0.1:6801/2904763972] [v2:127.0.0.1:6802/2904763972,v1:127.0.0.1:6803/2904763972] exists,up 783ebb70-0896-4959-a973-b07569417221 2026-02-12T20:58:26.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-12T20:58:26.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-12T20:58:26.343 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-12T20:58:26.343 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=144597 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-12T20:58:26.345 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-12T20:58:26.346 INFO:tasks.workunit.client.0.trial099.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-12T20:58:26.346 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-12T20:58:26.346 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-12T20:58:26.346 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-12T20:58:26.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-12T20:58:26.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-12T20:58:26.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-12T20:58:26.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-12T20:58:26.431 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-12T20:58:26.431 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-12T20:58:26.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-12T20:58:26.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-12T20:58:26.667 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-12T20:58:26.667 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-12T20:58:26.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-12T20:58:26.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-12T20:58:26.738 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-55834574851' 2026-02-12T20:58:26.739 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-12T20:58:26.739 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-55834574851 2026-02-12T20:58:26.739 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-12T20:58:26.740 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-12T20:58:26.740 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-55834574851 2026-02-12T20:58:26.740 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-12T20:58:26.741 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-12T20:58:26.741 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 55834574851' 2026-02-12T20:58:26.742 INFO:tasks.workunit.client.0.trial099.stdout:waiting osd.0 seq 55834574851 2026-02-12T20:58:26.742 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:58:26.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 55834574851 2026-02-12T20:58:26.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:58:27.973 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-12T20:58:27.974 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:58:28.214 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 55834574851 2026-02-12T20:58:28.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-12T20:58:29.215 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-12T20:58:29.216 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-12T20:58:29.448 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-12T20:58:29.448 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-12T20:58:29.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:58:29.449 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-12T20:58:29.775 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-12T20:58:29.776 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-12T20:58:30.008 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-12T20:58:30.009 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-12T20:58:30.009 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-12T20:58:30.009 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-12T20:58:30.338 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-12T20:58:30.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-12T20:58:30.339 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-12T20:58:30.339 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-12T20:58:30.340 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-12T20:58:30.411 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-12T20:58:30.412 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-12T20:58:30.412 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-12T20:58:30.412 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-12T20:58:30.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-12T20:58:30.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-12T20:58:30.413 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-12T20:58:30.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2488385536 2026-02-12T20:58:30.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-12T20:58:30.480 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-12T20:58:30.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-33005568 2026-02-12T20:58:30.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -33005568)' 2026-02-12T20:58:30.481 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 33005568 2026-02-12T20:58:30.481 INFO:tasks.workunit.client.0.trial099.stdout:33005568 2026-02-12T20:58:30.482 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 33005568 -gt 131072 ']' 2026-02-12T20:58:30.482 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-12T20:58:30.482 INFO:tasks.workunit.client.0.trial099.stdout:total_space_added = 0 2026-02-12T20:58:30.482 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -33005568' 2026-02-12T20:58:30.483 INFO:tasks.workunit.client.0.trial099.stdout:free_space_added = -33005568 2026-02-12T20:58:30.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-12T20:58:30.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-12T20:58:30.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: main: code=1 2026-02-12T20:58:30.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bluefs-volume-ops 1 2026-02-12T20:58:30.484 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-12T20:58:30.485 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-12T20:58:30.587 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-12T20:58:30.587 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-12T20:58:30.588 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-12T20:58:30.589 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-12T20:58:30.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-12T20:58:30.590 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-12T20:58:30.591 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-12T20:58:30.592 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:58:30.592 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-12T20:58:30.593 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-12T20:58:30.593 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T20:58:30.593 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:58:30.594 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-12T20:58:30.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-12T20:58:30.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-12T20:58:30.595 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-12T20:58:30.596 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-12T20:58:30.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-12T20:58:30.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-12T20:58:30.676 INFO:tasks.workunit.client.0.trial099.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.89625 2026-02-12T20:58:30.676 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.89625 2026-02-12T20:58:30.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T20:58:30.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-12T20:58:30.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-12T20:58:30.678 INFO:tasks.workunit.client.0.trial099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 1 2026-02-12T20:58:30.679 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-12T20:58:30.679 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-12T20:58:31.037 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-12T20:58:31.043 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T20:58:31.059 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T20:58:31.059 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T20:58:31.186 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T20:58:31.201 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T20:58:31.201 DEBUG:teuthology.orchestra.run.trial099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T20:58:31.217 INFO:teuthology.orchestra.run.trial099.stderr:bash: line 1: ntpq: command not found 2026-02-12T20:58:31.246 INFO:teuthology.orchestra.run.trial099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T20:58:31.246 INFO:teuthology.orchestra.run.trial099.stdout:=============================================================================== 2026-02-12T20:58:31.246 INFO:teuthology.orchestra.run.trial099.stdout:^* 23.157.160.168 2 7 377 105 +9883us[ +10ms] +/- 46ms 2026-02-12T20:58:31.246 INFO:teuthology.orchestra.run.trial099.stdout:^+ t2.time.gq1.yahoo.com 2 6 377 40 -27ms[ -27ms] +/- 69ms 2026-02-12T20:58:31.246 INFO:teuthology.orchestra.run.trial099.stdout:^- gopher.fart.website 3 7 377 40 +9217us[+9217us] +/- 95ms 2026-02-12T20:58:31.246 INFO:teuthology.orchestra.run.trial099.stdout:^+ ntp11.kernfusion.at 2 7 377 44 +6920us[+6920us] +/- 75ms 2026-02-12T20:58:31.247 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T20:58:31.260 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T20:58:31.260 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T20:58:31.273 DEBUG:teuthology.orchestra.run.trial099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T20:58:31.326 DEBUG:teuthology.orchestra.run.trial099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T20:58:31.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T20:58:31.392 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T20:58:31.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T20:58:31.421 INFO:teuthology.task.internal:Duration was 1600.971437 seconds 2026-02-12T20:58:31.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T20:58:31.435 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T20:58:31.436 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T20:58:31.473 INFO:teuthology.orchestra.run.trial099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T20:58:31.674 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T20:58:31.674 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial099.front.sepia.ceph.com 2026-02-12T20:58:31.675 DEBUG:teuthology.orchestra.run.trial099:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T20:58:31.733 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T20:58:31.733 DEBUG:teuthology.orchestra.run.trial099:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T20:58:31.814 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T20:58:31.814 DEBUG:teuthology.orchestra.run.trial099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T20:58:31.877 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T20:58:31.877 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T20:58:31.878 INFO:teuthology.orchestra.run.trial099.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T20:58:31.878 INFO:teuthology.orchestra.run.trial099.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T20:58:31.878 INFO:teuthology.orchestra.run.trial099.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T20:58:31.881 INFO:teuthology.orchestra.run.trial099.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T20:58:31.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T20:58:31.898 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T20:58:31.899 DEBUG:teuthology.orchestra.run.trial099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T20:58:31.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T20:58:31.963 DEBUG:teuthology.orchestra.run.trial099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:58:32.010 INFO:teuthology.orchestra.run.trial099.stdout:kernel.core_pattern = core 2026-02-12T20:58:32.022 DEBUG:teuthology.orchestra.run.trial099:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T20:58:32.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T20:58:32.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T20:58:32.093 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T20:58:32.095 DEBUG:teuthology.misc:Transferring archived files from trial099:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46720/remote/trial099 2026-02-12T20:58:32.096 DEBUG:teuthology.orchestra.run.trial099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T21:59:00.451 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T21:59:00.462 DEBUG:teuthology.orchestra.run.trial099:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T21:59:04.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T21:59:04.936 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T21:59:04.936 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T21:59:04.951 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T21:59:04.952 DEBUG:teuthology.orchestra.run.trial099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T21:59:04.968 INFO:teuthology.orchestra.run.trial099.stdout: 786525 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 12 21:59 /home/ubuntu/cephtest 2026-02-12T21:59:04.969 INFO:teuthology.orchestra.run.trial099.stdout: 930223 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 12 20:36 /home/ubuntu/cephtest/mnt.0 2026-02-12T21:59:04.969 INFO:teuthology.orchestra.run.trial099.stdout: 930224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 12 20:46 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T21:59:04.969 INFO:teuthology.orchestra.run.trial099.stdout: 1064389 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 12 20:46 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T21:59:04.969 INFO:teuthology.orchestra.run.trial099.stdout: 1064390 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 20:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-12T21:59:04.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T21:59:04.970 INFO:teuthology.orchestra.run.trial099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-12T21:59:04.971 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial099 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-12T21:59:04.973 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T21:59:04.990 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T21:59:05.006 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial099 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-12T21:59:05.011 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} duration: 1600.9714374542236 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial099 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T21:59:05.012 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T21:59:05.130 INFO:teuthology.run:FAIL